and backuped article:
Monday, March 14, 2016
Download file on windows by standard tools
Found interesting way - how to download file on windows only with standard tools (like how to make wget/curl on windows by standard tools) - [link]
and backuped article:
It can be useful, when you need do stuff like that and you don't add extra dependencies.
and backuped article:
Sort file by lines lengths
Often I need to sort file by length of lines and always I can't remember code which is doing this.
my @elements;
while(my $line = <>){
push @elements, $line;
}
@sorted = sort { length $a <=> length $b } @elements;
foreach my $l (@sorted){
print($l);
}
my @elements;
while(my $line = <>){
push @elements, $line;
}
@sorted = sort { length $a <=> length $b } @elements;
foreach my $l (@sorted){
print($l);
}
OpenPGP and annoying pinentry window
Foreword
I've started to use PGP in jabber (GnuPG for windows - Gpg4win - I've used this instruction). Backup of instruction just in case:
Problem
And every time when I've got incoming message in jabber - appeared windows 'pinentry' and asked me password (passphrase). It's very annoying and in the internet I didn't find solution for Windows OS.Window - looks like that:
Lyrics
So, in the internet there are lot of posts where people advices create file with properties - 'gpg-agent.conf', but usually it's about linux. Process monitor showed that in Windows this file expected to be in "C:\Users\username\AppData\Roaming\gnupg\gpg-agent.conf"Action
- Create file "C:\Users\username\AppData\Roaming\gnupg\gpg-agent.conf"
- Write in this file 2 lines (values can be any big number - it's seconds of caching your password):
- max-cache-ttl 2592000
- default-cache-ttl 2592000
- Restart your gpg-agent.exe process
Friday, November 20, 2015
'Copy to clipboard' button on web-page
Here are 3 ways to create such button:
API: document.execCommand("copy") - returns true if successed
You can check if it enable by document.queryCommandEnabled("copy") - returns true if enable
Simplest case:
<html>
<body>
<script src="https://ajax.googleapis.com/ajax/libs/jquery/1.11.1/jquery.min.js"></script>
<script LANGUAGE="JavaScript">
function ClipBoard(element) {
var $temp = $("<textarea visibility: hidden;>");
$("body").append($temp);
$temp.val(element).select();
document.execCommand("copy");
$temp.remove();
}
</script>
<button onclick="ClipBoard('test\ntest')">Copy to clipboard</button>
</body>
</html>
I've needed next actions for click:
But here are thing - w3c clipboard api works only for 'user-triggered thread' (and in the simplest using of ZeroClipboard it also doesn't work - maybe it need some another API for that - I don't know). And when you asking server by ajax - callback is another thread, not user-triggered. So, you can handle it next ways:
function copy_to_clipboard_button_handler()
{
if (data == '')
{
var request_data = ...;
$.ajax({
type: "POST",
url: this.url,
data: request_data,
async: false,
success: function(data)
{
global_object.clipboard_data = data;
}
});
}
var $temp = $("<textarea visibility: hidden;>");
$("body").append($temp);
$temp.val(global_object.clipboard_data).select();
document.execCommand("copy");
$temp.remove();
}
So.
- Use flash-based ZeroClipboard - it's flash - I don't like it
- Use clipboardData.SetData - works only for IE
- Use modern w3c clipboard API (supported by modern browsers) - IMHO the best way
API: document.execCommand("copy") - returns true if successed
You can check if it enable by document.queryCommandEnabled("copy") - returns true if enable
Simplest case:
<html>
<body>
<script src="https://ajax.googleapis.com/ajax/libs/jquery/1.11.1/jquery.min.js"></script>
<script LANGUAGE="JavaScript">
function ClipBoard(element) {
var $temp = $("<textarea visibility: hidden;>");
$("body").append($temp);
$temp.val(element).select();
document.execCommand("copy");
$temp.remove();
}
</script>
<button onclick="ClipBoard('test\ntest')">Copy to clipboard</button>
</body>
</html>
I've needed next actions for click:
- Ask data from server
- Copy it to clipboard
But here are thing - w3c clipboard api works only for 'user-triggered thread' (and in the simplest using of ZeroClipboard it also doesn't work - maybe it need some another API for that - I don't know). And when you asking server by ajax - callback is another thread, not user-triggered. So, you can handle it next ways:
- obsolete-but-working - not async ajax query
- you can ask data in background and keep it in browser - in button click handler copy existing data. It's bad when you have a lot of data
- you can ask user press button twice - first for loading, second for copying
- you can in click handler ask data by ajax & show textarea with selected text - let user copy it by himself.
function copy_to_clipboard_button_handler()
{
if (data == '')
{
var request_data = ...;
$.ajax({
type: "POST",
url: this.url,
data: request_data,
async: false,
success: function(data)
{
global_object.clipboard_data = data;
}
});
}
var $temp = $("<textarea visibility: hidden;>");
$("body").append($temp);
$temp.val(global_object.clipboard_data).select();
document.execCommand("copy");
$temp.remove();
}
So.
- 'async: false' means it will be user-triggered thread
- usually in examples used <input> but it kills newline symbols
- be careful with big amount of data - time for handling '$temp.val(global_object.clipboard_data).select()' grows exponential - on my desktop ~3MB handled ~20 seconds and ~30MB handled ~20 minutes and I didn't get patient to wait when it will finished. So, if you want copy more than several megabytes of data to clipboard - consider another variants - for example saving such amount of data to a file.
Monday, November 16, 2015
Mysql memo
Can't remember syntax of console mysql tools (bcs of rare using). Just put it here for myself:
dump database
"C:\Program Files\MySQL\MySQL Workbench 6.2 CE\mysqldump.exe" --host="%HOSTNAME%" --user=%USERNAME% --password=%PASSWORD% --result-file="out.txt" %DATABASE_NAME%
exec sql command
"C:\Program Files\MySQL\MySQL Workbench 6.2 CE\mysql.exe" -h %HOSTNAME% -u %USERNAME% --database=%DATABASE_NAME% --password=%PASSWORD% --execute="%QUERY" >out.txt
Using password in the command line string is insecure, so, possible to leave just '--password' without value. If not not to enter '--password', mysql think you want to connect without password and prints you an error.
dump database
"C:\Program Files\MySQL\MySQL Workbench 6.2 CE\mysqldump.exe" --host="%HOSTNAME%" --user=%USERNAME% --password=%PASSWORD% --result-file="out.txt" %DATABASE_NAME%
exec sql command
"C:\Program Files\MySQL\MySQL Workbench 6.2 CE\mysql.exe" -h %HOSTNAME% -u %USERNAME% --database=%DATABASE_NAME% --password=%PASSWORD% --execute="%QUERY" >out.txt
Using password in the command line string is insecure, so, possible to leave just '--password' without value. If not not to enter '--password', mysql think you want to connect without password and prints you an error.
Tuesday, November 10, 2015
Multilingual User Interface
Starting from Windows Vista there are appeared new mechanism - Multilingual User Interface.
If earlier you had one binary file where was code & strings, now it's another mechanism - you have 2 files: binary_filename (for example, crypt32.dll) + binary_filename.mui (for example, crypt32.dll.mui). Now binary file doesn't contain strings, and mui file have only one section - resources (name of section '.rsrc'), where in resource 'MUI' localize strings & their ID located. 'MUI' resource present and in binary with code - but there only a structure which helps find mui file.
MUI file located somewhere in C:\Windows\System32\en-US. en-US - strings in en-US languages, and every language pack presents own set of MUI files.
As I understood (didn't dig long & deeply, may be wrong), MUI file loaded by PE loader (by struct in 'MUI' resource in binary).
In binary with code to get string called LoadStringW() with id of this string.
So
What's good - logic & locale now divided, and you can switch locale dinamically.
What's bad - reversing of these binaries is hell now. If earlier you could find string in IDA, press 'x' and find usage - now you need go to MUI file, find ID, go to binary with code & search LoadStringW with this ID (and if you are lucky one - you will find it).
tiny article of MUI - [link] (note than 'FILEMUIINFO' struct - is not the same as in 'MUI' resource)
in comment here described struct in MUI resource - [link]
------------------------------------------------------------------------------------------
leave here are copy of that comment
------------------------------------------------------------------------------------------
The FILEMUIINFO structure is not equal to the MUI resource data. Further investigation of the resource data gives the following structure
// resource types defined by string only:
#define RT_MUI TEXT("MUI")
// default resource name
#define RESFILE32_MUI_RESNAME MAKEINTRESOURCE(1)
// mui signature
#define RESFILE32_MUI_SIGNATURE 0xFECDFECD
// mui version
#define RESFILE32_MUI_VERSION 0x00010000
// mui filetypes
#define RESFILE32_MUI_FILETYPE_MAIN 0x11
#define RESFILE32_MUI_FILETYPE_MUI 0x10
// ----
// notes about the checksum:
// ----
// - There are multiple methods given by MS about the calculation of the
// checksums.
// - The actual case is there is no calculation of the checksum by the
// resourceloader, it only compares checksums.
// - The checksums can be arbitary 16 byte codes.
// - The only requirement is that the MUI files have the same checksums in
// their MUI resources as the base LN file.
// ----
// one incomplete method given by MS:
// the main checksum is calculated from the major and minor version numbers of
// a file and the file name (case sensitive), which are obtained from the
// version resource
// the service checksum is calculated based on the localizable resources
// in the file
// ----
// another method given by MS:
// The most common convention for checksum handling is to base the checksum on
// the English (United States) resources. You are free to adopt a different
// convention, as long as it is consistent for each LN file. It is also
// acceptable to use the resource configuration file to assign an arbitrary
// hexadecimal value of up to 16 hexadecimal digits as a checksum. It requires
// adoption of a method using either GuidGen or some other tool to generate
// checksum values.
// ----
// mui header
// - followed by array of bytes referenced by the header
// - every offset is 64-bit aligned, padding bytes are added accordingly
typedef struct
{
UINT32 Signature; // equal to RESFILE32_MUI_SIGNATURE
UINT32 Size; // size in bytes of MUI header and payload
UINT32 RcCfgVersion; // equal to RESFILE32_MUI_VERSION
UINT32 Reserved1; // equal to 0
UINT32 FileType; // one of RESFILE32_MUI_FILETYPE_xxx
UINT32 Reserved2; // - SystemAttributes ???
UINT32 Unknown; // equal to 1 - UltimateFallbackLocation ???
BYTE MainChecksum[16]; // checksum, see notes
BYTE SvcChecksum[16]; // checksum, see notes
BYTE Reserved3[24];
UINT32 OfsMainTypeNames; // offset to list with non-numerical resource types in main file (as multistring)
UINT32 SzeMainTypeNames; // size in bytes of MainTypeNames
UINT32 OfsMainTypeIDs; // offset to list with numerical resource types in main file (as UINT32's)
UINT32 SzeMainTypeIDs; // size in bytes of MainTypeIDs
UINT32 OfsMuiTypeNames; // offset to list with non-numerical resource types in mui file (as multistring)
UINT32 SzeMuiTypeNames; // size in bytes of MuiTypeNames
UINT32 OfsMuiTypeIDs; // offset to list with numerical resource types in mui file (as UINT32's)
UINT32 SzeMuiTypeIDs; // size in bytes of MuiTypeIDs
UINT32 Reserved4;
UINT32 Reserved5;
UINT32 OfsFbLanguage; // offset to ultimate fallback language string
UINT32 SzeFbLanguage; // size in bytes of FbLanguage, including eos
//
} TResFile32_MuiHdr;
If earlier you had one binary file where was code & strings, now it's another mechanism - you have 2 files: binary_filename (for example, crypt32.dll) + binary_filename.mui (for example, crypt32.dll.mui). Now binary file doesn't contain strings, and mui file have only one section - resources (name of section '.rsrc'), where in resource 'MUI' localize strings & their ID located. 'MUI' resource present and in binary with code - but there only a structure which helps find mui file.
MUI file located somewhere in C:\Windows\System32\en-US. en-US - strings in en-US languages, and every language pack presents own set of MUI files.
As I understood (didn't dig long & deeply, may be wrong), MUI file loaded by PE loader (by struct in 'MUI' resource in binary).
In binary with code to get string called LoadStringW() with id of this string.
So
What's good - logic & locale now divided, and you can switch locale dinamically.
What's bad - reversing of these binaries is hell now. If earlier you could find string in IDA, press 'x' and find usage - now you need go to MUI file, find ID, go to binary with code & search LoadStringW with this ID (and if you are lucky one - you will find it).
added
Just now I tried to start 'calc.exe', copied to another dir - it didn't started! with debugger I found out, that it failed in LoadStringW() - this func returned 0 and everything finished. So, I guessed - windows PE loader searched it into subdir - for example if I put calc.exe to c:\mydir\calc.exe, mui file searched by path c:\mydir\en-US\calc.exe.muiUseful links
tiny article of MUI - [link] (note than 'FILEMUIINFO' struct - is not the same as in 'MUI' resource)
in comment here described struct in MUI resource - [link]
------------------------------------------------------------------------------------------
leave here are copy of that comment
------------------------------------------------------------------------------------------
The FILEMUIINFO structure is not equal to the MUI resource data. Further investigation of the resource data gives the following structure
// resource types defined by string only:
#define RT_MUI TEXT("MUI")
// default resource name
#define RESFILE32_MUI_RESNAME MAKEINTRESOURCE(1)
// mui signature
#define RESFILE32_MUI_SIGNATURE 0xFECDFECD
// mui version
#define RESFILE32_MUI_VERSION 0x00010000
// mui filetypes
#define RESFILE32_MUI_FILETYPE_MAIN 0x11
#define RESFILE32_MUI_FILETYPE_MUI 0x10
// ----
// notes about the checksum:
// ----
// - There are multiple methods given by MS about the calculation of the
// checksums.
// - The actual case is there is no calculation of the checksum by the
// resourceloader, it only compares checksums.
// - The checksums can be arbitary 16 byte codes.
// - The only requirement is that the MUI files have the same checksums in
// their MUI resources as the base LN file.
// ----
// one incomplete method given by MS:
// the main checksum is calculated from the major and minor version numbers of
// a file and the file name (case sensitive), which are obtained from the
// version resource
// the service checksum is calculated based on the localizable resources
// in the file
// ----
// another method given by MS:
// The most common convention for checksum handling is to base the checksum on
// the English (United States) resources. You are free to adopt a different
// convention, as long as it is consistent for each LN file. It is also
// acceptable to use the resource configuration file to assign an arbitrary
// hexadecimal value of up to 16 hexadecimal digits as a checksum. It requires
// adoption of a method using either GuidGen or some other tool to generate
// checksum values.
// ----
// mui header
// - followed by array of bytes referenced by the header
// - every offset is 64-bit aligned, padding bytes are added accordingly
typedef struct
{
UINT32 Signature; // equal to RESFILE32_MUI_SIGNATURE
UINT32 Size; // size in bytes of MUI header and payload
UINT32 RcCfgVersion; // equal to RESFILE32_MUI_VERSION
UINT32 Reserved1; // equal to 0
UINT32 FileType; // one of RESFILE32_MUI_FILETYPE_xxx
UINT32 Reserved2; // - SystemAttributes ???
UINT32 Unknown; // equal to 1 - UltimateFallbackLocation ???
BYTE MainChecksum[16]; // checksum, see notes
BYTE SvcChecksum[16]; // checksum, see notes
BYTE Reserved3[24];
UINT32 OfsMainTypeNames; // offset to list with non-numerical resource types in main file (as multistring)
UINT32 SzeMainTypeNames; // size in bytes of MainTypeNames
UINT32 OfsMainTypeIDs; // offset to list with numerical resource types in main file (as UINT32's)
UINT32 SzeMainTypeIDs; // size in bytes of MainTypeIDs
UINT32 OfsMuiTypeNames; // offset to list with non-numerical resource types in mui file (as multistring)
UINT32 SzeMuiTypeNames; // size in bytes of MuiTypeNames
UINT32 OfsMuiTypeIDs; // offset to list with numerical resource types in mui file (as UINT32's)
UINT32 SzeMuiTypeIDs; // size in bytes of MuiTypeIDs
UINT32 Reserved4;
UINT32 Reserved5;
UINT32 OfsFbLanguage; // offset to ultimate fallback language string
UINT32 SzeFbLanguage; // size in bytes of FbLanguage, including eos
//
} TResFile32_MuiHdr;
Tuesday, August 25, 2015
Add a bit unix functional to windows server
Problem.
I have server with windows. I worked with this server through RDP. And sometime GUI subsystem stop to work correctly, but logs of my service showed that everything other worked fine - processes, services. So, I've needed an not-GUI mechanism to work with this server.
Action.
1) Install freesshd
If it asks something like "should I generate the keys?" - answer 'yes'
If it asks something like "install the service?" - answer 'yes'
2) Run freesshd as administrator
3) Add user&pass (password stored as sha1_hash), set tick 'shell' - it gives your user access to ssh
4) Go to 'control panel -> windows firewall -> advanced' and allow access from outside to 22 port
5) Exit from your gui instance of freesshd
6) install gnuwin327) add c:\gnuwin32 to system PATH (not default user PATH)
8) install midnight commander for Windows
9) add dir with installed mc.exe to system PATH (not default user PATH)
10) Restart service freesshd ('control panel -> administrative tools -> services')
So. Now you can connect to your windows server via ssh (for example, in Putty), use in shell comfortable gnu utils & midnight commander. If midnight commander looks bad, try to run it 'mc -ac'.
Subscribe to:
Posts (Atom)