EldoS | Feel safer!

Software components for data protection, secure storage and transfer

SFTP receiving file issue

Also by EldoS: MsgConnect
Cross-platform protocol-independent communication framework for building peer-to-peer and client-server applications and middleware components.
#25742
Posted: 07/19/2013 17:43:31
by wenjin.pan@fnf.com (Priority Standard support level)
Joined: 08/22/2012
Posts: 4

I'm using BizCrypto SFTP Adapter to pick up files from a client sftp folder, PollingInterval is 120 seconds and the Delete Mode is "NEVER". The client drops files to the folder randomly. Once a while files are missing from the downloading. The files are always having the same name so sometime the client drops 2 files at the same time with eactly the same name.
Is that possible when 2 files with the same in the remote folder SFTP will only retrieve one of them?

I don't see any error in the log.
#25743
Posted: 07/20/2013 00:35:43
by Ken Ivanov (EldoS Corp.)

Hello Wenjin,

Thank you for contacting us.

It's an interesting question as one would rarely see an OS allowing two files with the same names to reside in one directory. The SFTP adapter works in the following way: it list the remote directory contents and then downloads appropriate files one by one, deleting each one right after the download. I suspect that a deletion request for the first file actually deletes both files.

What you can do here is use the safe download mode in Before Get configuration. This will make the component rename files before downloading them, resulting in deletion request being issued for the renamed file, thus not affecting the other file with the same name. The details on using safe download mode are available here.

Please attach the license ticket that you received in the product registration letter to your web site account. This will let us identify you as a license holder and provide you with faster technical support.
#25760
Posted: 07/22/2013 15:50:27
by wenjin.pan@fnf.com (Priority Standard support level)
Joined: 08/22/2012
Posts: 4

Thanks for reply so quick.

I tried to set the Safe Download Mode with following values:
Remote Path .
File Mask Some File Name.*
Delete Mode On Success
Safe Download Mode Before Get
Safe Download Name

And here is my event log:
[7/22/2013 2:24 PM] Searching for installed BizCrypto addons.
[7/22/2013 2:24 PM] BizCrypto.BizTalk.Addons library successfully loaded.
[7/22/2013 2:24 PM] EldoS SFTP Adapter: Loading private key
[7/22/2013 2:24 PM] EldoS SFTP Adapter: 1 keys have been loaded
[7/22/2013 2:24 PM] EldoS SFTP Adapter: Loading trusted keys
[7/22/2013 2:24 PM] EldoS SFTP Adapter: Opening connection to SFTP server
[7/22/2013 2:24 PM] EldoS SFTP Adapter: Running key validation handler
[7/22/2013 2:24 PM] EldoS SFTP Adapter: All keys are trusted, exiting
[7/22/2013 2:24 PM] EldoS SFTP Adapter: Authentication succeeded
[7/22/2013 2:24 PM] EldoS SFTP Adapter: Server introduced himself as Connect:Enterprise_UNIX_2.4.02
[7/22/2013 2:24 PM] EldoS SFTP Adapter: SFTP connection started
[7/22/2013 2:24 PM] EldoS SFTP Adapter: Downloading files...
[7/22/2013 2:24 PM] Eldos FTPS Adapter: Rename ./Some File Name.130722152331 to ./Some File Name.a3ebdabe-c7a1-44a2-abb3-716a6c707857
[7/22/2013 2:24 PM] EldoS SFTP Adapter: Downloading file Some File Name.130722152331 from ./ error: No such file
[7/22/2013 2:24 PM] EldoS SFTP Adapter: Download done
[7/22/2013 2:24 PM] EldoS SFTP Adapter: Closing the connection
[7/22/2013 2:24 PM] EldoS SFTP Adapter (receive): PickupFilesAndSubmit() downloaded 0 file(s).
[7/22/2013 2:24 PM] EldoS SFTP Adapter (receive): PickupFilesAndSubmit(): No files to submit.
[7/22/2013 2:26 PM] EldoS SFTP Adapter (receive): ControlledEndpointTask()
[7/22/2013 2:26 PM] EldoS SFTP Adapter (receive): EndpointTask()

It looks like it does rename the file by replacing the last part of the filename with a GUID, but then try to download the file with the old name.


As for the license ticket, the person who purchase the license has left the company and the consequence is we lost the registration email... In this case is that possible that you resend us the license ticket?

Thanks you.
#25765
Posted: 07/23/2013 00:31:33
by Ken Ivanov (EldoS Corp.)

Wenjin,

There was a glitch similar to what you describe in one of older BizCrypto versions. Please upgrade your installation to the latest BizCrypto 9 version (9.1.216). Upgrade instructions are available in the help file installed locally or here. After upgrading the property should work correctly for you.

Regarding the license, I've created a Helpdesk ticket for you. Let's discuss the possible options of restoring your license there.
#25778
Posted: 07/23/2013 22:23:09
by wpan (Basic support level)
Joined: 06/24/2010
Posts: 3

I've upgraded my BizCrypto from 9.1.214 to 9.1.216.

However I got error message in the event log:

[7/23/2013 17:32:49.379] Searching for installed BizCrypto addons.
[7/23/2013 17:32:49.379] No addons found (the exact message: BizCrypto.BizTalk.Addons. Could not load file or assembly 'BizCrypto.BizTalk.Addons, Version=9.1.216.0, Culture=neutral, PublicKeyToken=5a62fa96d0ac431a' or one of its dependencies. The system cannot find the file specified.)

In version 9.1.214, there existed BizCrypto.BizTalk.Addons.dll in the Assemblies\NET_20 folder while 9.1.216 does not. Is there a separate install package for the AddOns? Or the missing dlls will not have any impact at runtime?

Thanks
#25779
Posted: 07/24/2013 00:28:28
by Ken Ivanov (EldoS Corp.)

Hello,

Please disregard that message. The addons assembly used to contain IDEA algorithm functionality in earlier product versions, however, the assembly was deprecated in version 9.1.215 following the move of IDEA functionality to the standard assembly set after the algorithm's patent had expired. This way, there is no addons assembly in version 9.1.216 but the check for it and the log message was inherited from earlier times.
#25792
Posted: 07/24/2013 11:50:04
by wenjin.pan@fnf.com (Priority Standard support level)
Joined: 08/22/2012
Posts: 4

Thanks for the clarification.

Here is the production server event log after upgrading to the latest version:
[7/24/2013 10:15:43.801] EldoS SFTP Adapter (receive): Updating receiver endpoint.
[7/24/2013 10:15:43.807] EldoS SFTP Adapter (receive): Stop()
[7/24/2013 10:15:43.811] EldoS SFTP Adapter (receive): Start()
[7/24/2013 10:15:43.832] Searching for installed BizCrypto addons.
[7/24/2013 10:15:43.836] No addons found (the exact message: BizCrypto.BizTalk.Addons. Could not load file or assembly 'BizCrypto.BizTalk.Addons, Version=9.1.216.0, Culture=neutral, PublicKeyToken=5a62fa96d0ac431a' or one of its dependencies. The system cannot find the file specified.)
[7/24/2013 10:15:43.861] Searching for installed BizCrypto addons.
[7/24/2013 10:15:43.865] No addons found (the exact message: BizCrypto.BizTalk.Addons. Could not load file or assembly 'BizCrypto.BizTalk.Addons, Version=9.1.216.0, Culture=neutral, PublicKeyToken=5a62fa96d0ac431a' or one of its dependencies. The system cannot find the file specified.)
[7/24/2013 10:15:43.869] EldoS SFTP Adapter: Loading private key
[7/24/2013 10:15:43.876] EldoS SFTP Adapter: 1 keys have been loaded
[7/24/2013 10:15:43.879] EldoS SFTP Adapter: Loading trusted keys
[7/24/2013 10:15:43.883] EldoS SFTP Adapter: Opening connection to SFTP server
[7/24/2013 10:15:44.209] EldoS SFTP Adapter: Running key validation handler
[7/24/2013 10:15:44.213] EldoS SFTP Adapter: All keys are trusted, exiting
[7/24/2013 10:15:44.619] EldoS SFTP Adapter: Authentication succeeded
[7/24/2013 10:15:44.715] EldoS SFTP Adapter: Server introduced himself as Connect:Enterprise_UNIX_2.4.02
[7/24/2013 10:15:44.719] EldoS SFTP Adapter: SFTP connection started
[7/24/2013 10:15:44.723] EldoS SFTP Adapter: Downloading files...
[7/24/2013 10:15:44.852] EldoS SFTP Adapter: Obtained file list for ./ and mask SSHF ECS OUTBNR CAFSECS.* (2 items):
[7/24/2013 10:15:44.857] EldoS SFTP Adapter: - SSHF ECS OUTBNR CAFSECS.130724111533 (f)
[7/24/2013 10:15:44.860] EldoS SFTP Adapter: - SSHF ECS OUTBNR CAFSECS.130724111542 (f)
[7/24/2013 10:15:44.864] EldoS SFTP Adapter: Downloading file SSHF ECS OUTBNR CAFSECS.130724111533 from ./SSHF ECS OUTBNR CAFSECS.130724111533
[7/24/2013 10:15:44.867] Eldos SFTP Adapter: Renaming ./SSHF ECS OUTBNR CAFSECS.130724111533 to ./SSHF ECS OUTBNR CAFSECS.bc6b2c12-4ae2-4040-ab3a-ea05880b3921
[7/24/2013 10:15:45.079] EldoS SFTP Adapter: Downloading file SSHF ECS OUTBNR CAFSECS.130724111533 from ./ error: No such file
[7/24/2013 10:15:45.083] EldoS SFTP Adapter: Downloading file SSHF ECS OUTBNR CAFSECS.130724111542 from ./SSHF ECS OUTBNR CAFSECS.130724111542
[7/24/2013 10:15:45.087] Eldos SFTP Adapter: Renaming ./SSHF ECS OUTBNR CAFSECS.130724111542 to ./SSHF ECS OUTBNR CAFSECS.f9c061a9-e3f5-469d-91b3-14adff80e2a0
[7/24/2013 10:15:45.397] EldoS SFTP Adapter: Downloading file SSHF ECS OUTBNR CAFSECS.130724111542 from ./ error: No such file
[7/24/2013 10:15:45.401] EldoS SFTP Adapter: Download done, 0 files processed
[7/24/2013 10:15:45.405] EldoS SFTP Adapter: Closing the connection
[7/24/2013 10:15:45.409] EldoS SFTP Adapter (receive): PickupFilesAndSubmit() downloaded 0 file(s).
[7/24/2013 10:15:45.413] EldoS SFTP Adapter (receive): PickupFilesAndSubmit(): No files to submit.


I can see the files on the client folder were renamed, but no file was downloaded.
My "Delete Mode" is set to "Never" since thethe customer server will automatically delete the file after it's downloaded. Is it possible because of that?

Here is my Safe Download Mode setting:
Safe Download Mode: Before Get
Safe Download Name:
#25804
Posted: 07/25/2013 01:28:09
by Ken Ivanov (EldoS Corp.)

Wenjin,

Thank you for the details.

The value of the Delete Mode property does not affect the adapter execution flow, as the error apparently occurs before the file is selected (or not selected) for deletion. In any case, it should not affect the transfer.

I suspect that the problem is specific to the nature of the names the files are renamed to before the download. Could you please set the Safe Download Name property in the following way and check if it helps to make the renamed files downloadable:

Safe Download Name = ./temp_%Random64%

The trace is a bit misleading in the sense that it reports the problem as occurring with the old file name (before renaming), while the actual download request was actually attempted for the new one (after renaming).
Also by EldoS: CallbackRegistry
A component to monitor and control Windows registry access and create virtual registry keys.

Reply

Statistics

Topic viewed 5883 times

Number of guests: 1, registered members: 0, in total hidden: 0




|

Back to top

As of July 15, 2016 EldoS Corporation will operate as a division of /n software inc. For more information, please read the announcement.

Got it!