EldoS | Feel safer!

Software components for data protection, secure storage and transfer

Https Post Results Truncated

Also by EldoS: RawDisk
Access locked and protected files in Windows, read and write disks and partitions and more.
#17382
Posted: 08/30/2011 11:11:51
by Matthias H (Standard support level)
Joined: 08/30/2011
Posts: 5

Hi,

I am using blackbox 9.0.203 Evaluation version with Delphi 6

I am posting an XML string to an https server and receive an XML stream back.
What I receive back works fine if it's reasonably small, if it's bigger however it seems to be truncated.

The log for the OnProgress event shows:

11-08-30 16:51:04 0 of 897
11-08-30 16:51:30 897 of 897
11-08-30 16:52:31 0 of 1625976
11-08-30 16:52:38 2298 of 1625976

I suppose 897 is the XML I am sending.
I assume the total length of what I should receive is 1625976. The progress only shows 2298 and then stops.

Also the size parameter in the OnData event is 2298.

(Note, the size is not always the same but roughly around the 2300 mark)

Is this a limitation in the Evaluation version? Or what is going on here?

Btw, the OnError event does not fire so I suppose there is no error in the connection.


Matthias
#17383
Posted: 08/30/2011 12:13:17
by Eugene Mayevski (EldoS Corp.)

Something is wrong there. The question is "what" and if a problem even exists.

If I understood you right, data have been posted correctly and response is not received right.

First thing to check is set HTTPVersion to HTTP 1.0 (to exclude chunked encoding) and turn off keep-alives (set PreferKeepAlive property to false). If this solves the problem, then there's no need to check other steps below.

If turning on HTTP 1.0 doesn't help, then the problem can be somewhere on transport level. Try using some GET requests to the same server and also from some other server.

Finally, check that you don't have a firewall or proxy in the middle. It can be that the proxy is stuck or holds incomplete data (we came across such issues before).


Sincerely yours
Eugene Mayevski
#17395
Posted: 08/31/2011 03:53:56
by Matthias H (Standard support level)
Joined: 08/30/2011
Posts: 5

Hi,

The HTTP was set to 1.0, Keep Alive was turned off. The only firewall was my Windows firewall and turning it off made no difference.

I tried a Get, which works fine, but because the server is missing the data from the Post, the response is only a 300 bytes long and therefore seems to be no problem. It also works fine when I change the Post data to receive a different (shorter) document. It only seems to come into effect once the size is too big.

I am attaching the headers I am receiving after the Post, maybe you can spot something.

I can send you an sample application if you like.

Thanks,
Matthias
#17396
Posted: 08/31/2011 03:55:00
by Matthias H (Standard support level)
Joined: 08/30/2011
Posts: 5

attached it a screenshot of the header info


#17403
Posted: 08/31/2011 05:39:53
by Eugene Mayevski (EldoS Corp.)

This is confusing, especially as no chunked encoding is involved. I'll get back to you as soon as we test the issue (later today).


Sincerely yours
Eugene Mayevski
#17404
Posted: 08/31/2011 06:47:57
by Matthias H (Standard support level)
Joined: 08/30/2011
Posts: 5

Hi,

I don't know if it helps but it looks to me as if the full 1.6 MB is being received, as it takes about 30-40 seconds after the connection is made and the HD lights are flashing during that time (or is that the Evaluation delay?). This is however before the BeginDoc event is called.

Thanks,
Matthias
#17405
Posted: 08/31/2011 07:02:41
by Eugene Mayevski (EldoS Corp.)

Yes, slow download speed is a limitation of the evaluation license. I will send you a full-speed trial key by e-mail now, please check if it solves the problem.


Sincerely yours
Eugene Mayevski
#17407
Posted: 08/31/2011 07:54:37
by Matthias H (Standard support level)
Joined: 08/30/2011
Posts: 5

Thanks for the key, unfortunately the problem persists. You wouldn't have a sample program that sends an XML string to a website and writes the result into a file? Alternatively I could send you the XML and the web address I am sending it too and you could test if you can get the full response file.

Thanks,
Matthias
#17408
Posted: 08/31/2011 08:15:08
by Eugene Mayevski (EldoS Corp.)

lets continue in Helpdesk


Sincerely yours
Eugene Mayevski
#17409
Posted: 08/31/2011 12:49:29
by Eugene Mayevski (EldoS Corp.)

For everyone: slow response speed was a consequence of the server preparing and packing 20 Mb of response data.

The problem with incomplete data was caused by the intermittent bug in decompression routine in HTTPS client in version 9 (the bug will be fixed in the upcoming build, which is expected in about a week or two).

The real problem was that the server ignored client request and always sent compressed data (i.e. it's not possible to disable compression for this particular buggy server).
Also by EldoS: CallbackProcess
A component to control process creation and termination in Windows and .NET applications.

Reply

Statistics

Topic viewed 1091 times

Number of guests: 2, registered members: 0, in total hidden: 0




|

Back to top

As of July 15, 2016 EldoS Corporation will operate as a division of /n software inc. For more information, please read the announcement.

Got it!