Object Mover Advanced Configuration

Some environments require additional configuration to transfer specific file types, ensure network connectivity, and optimize file transfers for your organization.

When adding or editing a job, click the Advanced tab to view and set additional configuration options.

Note: Advanced options vary by job type. Some configuration options may not be available for certain jobs.

Source

File Patterns

Include File Patterns includes all file names/types by default. You can configure specific file patterns and extensions to include specific file types in your transfer. Separate multiple patterns with commas.

You can use expression characters to provide granular specificity to transfer jobs.

ExpressionAction
*Match zero or more characters
?Match a single character in a file name
[...]Match enclosed characters (e.g. [ch] matches files with c and h)
[A-z] or [1-9]Match a range of letters or numbers
[^A-z] or [!A-z]Do not match a range of letters or numbers

Note: To search for files that contain expression characters in their name, escape the character using \.

You can also exclude subdirectories if necessary. To exclude a subdirectory at a specific level, use the @ character:

Example PathDescription
C:\Example\SubdirectoryInclude Subdirectory
C:\Example\@SubdirectoryExclude Subdirectory

File Readiness

  • Set the File Readiness Check Type to determine how the job will check if files are ready for transfer:

    • None: No checks are made.
    • Stream Growing Files: Starts a transfer as files are being copied to the source, and attempts the transfer as data is written to the source.
    • Consecutive Seek (Recommended): Reads the last few bytes of the file, then after a specified number of delay, reads the same bytes again. If the content matches, the file is transferred.
    • MD5 Hash: Uses an MD5 Hash to compute a hash on files. After a specified delay, the MD5 hash of a file is checked. Only files with identical hashes are transferred. Job initialization can take a long time for larger file sizes.
    • Date/Time and Size: Checks the date, time, and size of a file twice. Files without changes are transferred.
  • Select a Readiness Check Delay to set the pause, in seconds, between the two phases of MD5 Hash, Consecutive Seek, or Date/Time and Size file readiness checks. The default delay is 10 seconds. When choosing to Stream Growing Files, this is the time that must pass without file changes for the file to be declared complete.

Source Data Action

Use the Source Data Action After Successful Transfer to set a file deletion option to remove files from the source storage after a successful transfer.

Ensure you have the most up to date version of the transfer utility installed on any Agents using object transfer:

Destination Specification

In ObjectDownloader, you can select Directory Mapping Options.

  • Set a Job Date/Time and select the Maximum Job Date-Time Directories. The default is 10 directories.

  • Choose whether to Remove Expired Files/Directories on Target and set the Expiration Period, which is 30 days by default.

Transport Options

The Transport Options section modifies the protocol (UDP/TCP) and bandwidth used during a job run by Agents prior to or after files are uploaded or downloaded from object storage to an Agent. Modifying a job's transport options allows control over the way data moves between all of the Agents associated with an Object Mover job.

Note: Transport options do not control the way Flight Gateway works with cloud object storage.

  • Configure Simultaneous Transfer Streams to optimize transfer performance between Agents.

  • Enable Use UDP Control Channel for configurations where connections must pass from a perimeter network to an Agent within a private network that blocks TCP traffic.

Note: When Use UDP Control Channel is set to Yes, file transfers automatically use UDP WAN acceleration, which overrides the Use WAN Accelerator setting.

WAN Acceleration

  • Select whether to Use WAN Accelerator. This setting uses all available bandwidth up to the user-specified bandwidth maximum. Use this option on high-latency, high-bandwidth networks where throughput is a top priority. If the throughput is less than 57200 Bps, the transfer will switch to TCP. WAN Acceleration is enabled by default.

  • Set the WAN Accelerator Aggressiveness to configure the job's sensitivity to other network traffic. The higher the level of aggressiveness, the less the job accommodates other network traffic. The WAN Accelerator Aggressiveness setting also specifies how aggressively the transfer attempts to reclaim bandwidth after packet loss.

    There are three levels of aggressiveness:

    • High - When 3% packet loss is detected, the transfer rate slows to 94% of the current transfer rate. The transfer waits 20ms before trying to increment the transfer rate by 5%.
    • Medium - When 2% packet loss is detected, the transfer rate slows down to 93% of the current transfer rate. The transfer waits 40ms before trying to increase the transfer rate by 4%.
    • Low - When 1% packet loss is detected, the transfer rate slows to 91% of the current transfer rate. The transfer waits 80ms before trying to increment the transfer rate by 3%.

Bandwidth Configuration

Configuring a job to use limited bandwidth can improve network performance for other activities.

  • Set a Bandwidth Ceiling to configure the maximum throttle rate for the transfer. Enter 0 to enable auto-detection for the best bandwidth rate.

  • Set a Bandwidth Floor to configure the minimum rate at which data should be sent. Enter 0 to enable auto-detection for the best bandwidth rate. If WAN Accelerator Aggressiveness is set to Medium or Low, the rate specified here will be used.

Note: Bandwidth throttle control is a goal for the average transfer rate over the duration of the job. If the transfer rate falls below the bandwidth floor due to network congestion, bandwidth may exceed the bandwidth ceiling to bring the transfer rate within the required transfer rate.

  • Set Bandwidth Throttle by Time of Day to configure bandwidth to reduce network usage during periods of higher demand. Click + to add additional time parameters, or click x to remove them.

Note: Once a job has started, all bandwidth throttles account for Daylight Savings Time (DST). If DST changes while the job is running, bandwidth time of day changes may be off by an hour.

Advanced Options

Encryption

Jobs can include a set Encryption Level. The default is No Encryption – unsigned.

  • No encryption – signed: Transfers unencrypted data, but includes the SSL protocol's message digest calculation and signing to ensure data stream integrity.
  • No encryption – unsigned: After the initial SSL authentication of the endpoints, this setting allows the transfer of data to proceed with no encryption, no message digest computation, and no signing of the message digests. This mode of operation is only for raw performance, since it makes no guarantee of the integrity of the data stream other than the default one has with a normal network channel. The underlying TCP protocol can guarantee the integrity of messages across each single network hop, but has no facilities for detecting a man-in-the-middle attack.

Note: Mutual authentication is always used, regardless of the encryption level specified. Encryption is done in-stream and not on disk prior to sending.

Delivery Mode

  • Set a Delivery Mode to define the performance level and details recorded when conducting transfers.

    • Level 1 - No Checkpoint Restart: Does not create temporary work files. This mode is optimized for speed.
    • Level 2 - Checkpoint Restart: Uses temporary work files during transfer. Temporary files allow an interrupted transfer to resume from where the interruption occurred. The creation of temporary files adds time to the transfer, but provides resiliency.
    • Level 3 - Checkpoint Restart, Filename Logging: Logs file names transferred as part of the job log.
    • Level 4 - Checkpoint Restart, Filename Logging, Certified Delivery: Creates an Agent certified delivery log of files transferred, and allows File Search on the Manager Dashboard.

Notification And Logging

  • Select the Log Detail Level. More detailed logs can result in slower transfer performance.

    • Error: Report job errors. Recommended for highest performance.
    • Warn: Report non-critical issues as well as errors.
    • Info: Report job status, details, errors, and non-critical issues.
    • Debug: Report all available job details. Debug logs provide the most detail, but can significantly reduce transfer performance.

Schedule

  • Select additional time parameters such as time zone and start/end times, choose whether a transfer should be interrupted upon failure, and set the job's queuing priority based on other jobs.
Was this page helpful?
About SigniantSigniant’s intelligent file movement software helps the world’s top content creators and distributors ensure fast, secure delivery of large files over public and private networks. Built on Signiant’s patented technology, the company’s on-premises software and SaaS solutions move petabytes of high-value data every day between users, applications and systems with proven ease.LEARN MORE