Contact Us

If you still have questions or prefer to get help directly from an agent, please submit a request.
We’ll get back to you as soon as possible.

Please fill out the contact form below and we will reply as soon as possible.

  • Contact Us
  • Home
  • Migrations
  • Migration Jobs
  • Advanced Job Options

Job Filtering

Learn how to control content migration using filters.

Written by Andrea Harvey

Updated at June 23rd, 2025

Contact Us

If you still have questions or prefer to get help directly from an agent, please submit a request.
We’ll get back to you as soon as possible.

Please fill out the contact form below and we will reply as soon as possible.

  • Insights
    Prebuilt Insights Custom Insights
  • Content
  • Accounts
  • Activity Log
  • Content Scans
  • Migrations
    Migration Jobs Migration Reports Maps Flagged Items Migration Tools
  • Connections
    Supported Platform Connections Creating Connections Connection Maintenance Connection Pools
  • Entity Types
    DryvIQ Available Entity Types Custom Entity Types Entity Type Maintenance
  • Action Sets
    Creating Action Sets Action Sets Maintenance
  • Settings
    License Performance Notifications Extensions Entity Types Settings Display Settings Configuration
  • API, CLI, and SDK Documentation
    REST API Documentation Command-line Interface SDK Development
  • POC Offering
  • Release Notes
+ More

Table of Contents

Overview Adding Custom Filters Using Multiple Include or Exclude Filters Overlapping Filters Filtering and Scripting Filter Options Ignore Hidden Items Ignore Shared Items Age Date Range File Extension File Size File Type Metadata Content Name Pattern Specific File or Folder

Overview

Filtering allows you to set rules that determine which items are included in or excluded from the transfer. Files may be filtered based on metadata attributes, file size, item name patterns, and extensions. This feature is helpful for customers who need to transfer only a subset of items based on certain file characteristics.

DryvIQ applies the job filters to all items that have changed on subsequent job runs. This means that an item that did not transfer on a previous job run may transfer on a subsequent run due to changes that cause the item to now meet an include filter criterion. Similarly, an item that was originally transferred could be skipped if the update causes it to now meet an exclusion filter criterion. 

Filtering is not available for intelligent migration jobs. 

 

Adding Custom Filters

  1. When you choose to add a custom filter, you must first choose if you are adding an “include” or “exclude” filter. 


     
  2. Once you select the filter type, you can choose the specific filter rules you want to add. Based on the rule type you choose, you will specify additional information for the rule. Refer to the individual filter sections below for details on how to use each filter. 

Using Multiple Include or Exclude Filters

If you need to add multiple rules to an include or exclude filter, you must ensure you handle them as follows:

  • Multiple Exclude Filters: You must add a separate exclude filter for each rule you want to use.
  • Multiple Include Filters: You must add all rules to one include filter. 
 

Overlapping Filters

When using multiple filters, any include filters will be overwritten/ignored if an overlapping exclude filter is included on the job. For example, if you choose to include a specific file based on path but the file type meets a type specified in an exclude filter, the file will not transfer. 

 

Filtering and Scripting

You cannot use Filtering and Scripting together to add filters to the job. Any filters added using scripting will be overwritten by any custom filters added on the Filtering page.

 

Filter Options

Below are the available filters. Expand a filter to learn more about it. 

Ignore Hidden Items

When creating a job through the user interface, the option to ignore (exclude) hidden files during transfers is selected by default. To include hidden files, clear the Ignore hidden items box. 

 

 
 

Ignore Shared Items

Shared items are those available to the account but not owned by it. Excluding shared items is useful when multiple accounts are being migrated, ensuring duplicate content is not created on the receiving platform. When the filter is set on a job, DryvIQ will only transfer items that are owned by the account the job is running as. The appropriate permissions will need to be applied to the item once it is transferred (either through permission migration or manual permission mapping) for other accounts to have access to the item on the destination.

DryvIQ only detects the folder as shared if the connection owner is not the owner of the shared folder. DryvIQ does not track ownership of content excluded by filter-shared.

 

 

 
 

Age

The age filter allows you to include or exclude content based on its created on, modified on, and/or last touched date. Use the Date types list to select the date type you want to use. Note that any combination of the dates can be selected. Specify the number of days you want to use in the Within the last field. 

Select the date type.

 

Specify the number of days. 

 

 
 

Date Range

The date range filter allows you to filter content based on its created on, modified on, and/or last touched date. You can choose to use the After or Before date field but not both. Type the date you want to use as the filter or use the calendar tool to select the date. 
 

Select the date type(s). 

 

Select the dates.

 

 
 

File Extension

The file extension filter will include or exclude files based on the file extensions you specify. Simply type the extensions you want to filter separated by commas.

 

 
 

File Size

This filter allows you to filter content based on its size (in bytes). You can filter all files greater than or less than a specified size.  

 

 
 

File Type

The file type filter allows you to filter content by type (audio, documents, etc.). This filter should be used over the file extension filter when you are looking to filter out a type of content. It allows you to do so without having to specify the various extensions. 

 

 
 

Metadata Content

To filter items by metadata, the target platform must support metadata. If the target platform does not support metadata, the "Metadata Content" custom filter will be disabled. To filter metadata content, both the Filtering and Scripting options need to be enabled on the Advanced setting page. The Metadata Mapping option should not be enabled. 

Filtering metadata is not supported when using the Metadata Import function. Any metadata content filters configured with Metadata Import will be ignored.

 

 

Format

Metadata should be entered using the one of the following formats:

  • [Property]="Text"
  • [Property]=Numeric Value
  • [Property]="Text 1" OR [Property]="Text 2"
  • [Property]=Numeric Value 1 AND [Property]=Numeric Value 2

The following example excludes items with value "Doe" for the property value LName metadata column on the Source platform.

The following example excludes items with value "Doe" or “Smith” for the property value LName metadata column on the Source platform.

Identifying the Columns to Filter

Populate the property name value that corresponds with metadata content column.

"transfer" : {
"metadata_map": {
                "schemas": [
                    {
                        "mappings": [
                            {
                                "source": {
                                    "property": {
                                        "name": "LName",
                                        "type": "string"
                                    }
                                },
                                "destination": {
                                    "property": {
                                        "name": "LName",
                                        "type": "string"
                                    }
                                }
                            }
                        ]
                    }
                ]
            }
}
}

 

 
 

Name Pattern

This filter allows you to filter files and/or folders based on the name pattern. An asterisk can be used for exact matches or for prefix or suffix matches. For example, *txt would filter all .txt extensions. You can also use asterisks to surround a pattern to filter file and/or folder names. For example, using *test* would filter all names that contain “test.” Use semicolons for multiple match patterns. For example, *test*;*draft* would filter all names that contain “test” or “draft.” 

 

 
 

Specific File or Folder

This filter allows you to include or exclude specific files or folders from the source connection based on the exact path you specify. Paths are case sensitive and should be specified using the proper case as it exists in the folder or file path.

  1. In the Rule type list, select Specific file or folder.
  2. Click the Edit link at the end of the Select a specific file or folder to filter field.
  3. A modal appears. Either navigate to the file or folder you want to filter or click Manually enter a path to type the exact path. The path will be relative to the source path and should start with a forward slash (/) as in the example below. Paths are case sensitive and should be specified using the proper case as it exists in the folder or file path.
     
Select the path or enter the path to use. 
  1. Once you specify the path, click Use this path.
  2. The path displays in the Select a specific file or folder to filter field for your reference.
  3. Click Done to complete adding the filter to the job.

Editing a Filter

  1. Click Edit next to the filter.
  2. Click Edit again on the Select a specific file or folder to filter field.
  3. Use the modal that appears to edit the path.
  4. Once you specify the path, click Use this path.
  5. The path is displayed in the Select a specific file or folder to filter field for your reference.
  6. Click Done to finish editing the filter.

Removing a Filter

  1. Click Edit next to the filter.
  2. Click the Delete rule link that appears under the filter information.
  3. Click Yes when prompted to verify you want to delete the filter.
 
 

 

 

filters job filters ignore hidden items ignore shared items specific file or folder name pattern metadata content file type file size file extension data range age

Was this article helpful?

Yes
No
Give feedback about this article

Related Articles

  • Connection Platform API Client Credentials
  • Supported Authentication Types
  • Connection User Type

Copyright 2025 – DryvIQ, Inc.

Knowledge Base Software powered by Helpjuice

Expand