The DataProcessing Tool provides elementary functionality for working with metadata, layerfiles and mxd-files in ArcGIS or in a Python GUI/IDE like IDLE, PythonWin or PyScripter. Time consuming and complex management tasks can easily, efficiently and reproducibly be performed using Python scripts.
Large amounts of data and metadata
The Netherlands Environmental Assessment Agency (Planbureau voor de Leefomgeving, PBL) manages a large quantity of data and related metadata inside an infrastructure based upon ESRI software and standards. However the existing solutions showed limitations when managing these data and metadata.
The solution similar to Geoprocessing
The DataProcessing Tool was developed to simplify the management of data and metadata and to make it less time-consuming. The tool is a library of objects and functions, which can be used in Python scripts. The tool is thus similar to the ArcGIS Geoprocessing automation library.
Basic objects and functions
The DataProcessing Tool is a DLL that contains the basic functionality for working with metadata, layerfiles and mxd-files. The tool contains among other things the following functionality:
- Create metadata templates and layerfiles.
- Search/query and edit/update metadata.
- Search/query layers in layerfiles and mxd-files.
- Search/query and edit/update layer properties, such as the data source.
- Search/query and edit/update DataFrame properties in mxd-files.
- Export metadata to XML.
Time-consuming or complex management tasks
The usage of basic objects of the DataProcessing Tool and Python scripts facilitates that time-consuming and complex management tasks are performed easily, efficiently and reproducibly from ArcMap or ArcCatalog.
For example the following tasks become straightforward:
- Searching and replacing of certain text in all metadata.
- Changing the paths of data sources in all layer files in a certain workspace.
- Exporting a selection of the metadata to a database.
- Synchronizing of all metadata.
Working with metadata using shortcuts
Shortcuts can be defined for frequently-used metadata features (the XML-tags). When subsequently querying or updating metadata these shortcuts can be used, instead of long and sometimes rather cryptical XML-tags.
Arjan van der Put, PBL:
"The DataProcessing Tool gave the PBL a tool for efficient en flexible data and metadata management. The use of Python scripts gives the tool unlimited usage possiblities and makes it easy to add new management tasks."
In version 4.6 the following modifications were made:
- Support for ArcGIS 10.6 (version 4.6.6)
- Warning during install when the required pywin32 package / win32com.client is not installed
Required is one of the following ArcGIS 9.2, ArcGIS 9.3, ArcGIS 9.3.1, ArcGIS 10.0, ArcGIS 10.1, ArcGIS 10.2/10.2.1/10.2.2, ArcGIS 10.3/10.3.1, ArcGIS 10.4/10.4.1, ArcGIS 10.5/10.5.1 or ArcGIS 10.6 licenses:
- ArcView / ArcGIS Desktop Basic
- ArcEditor / ArcGIS Desktop Standard
- ArcInfo / ArcGIS Desktop Advanced
The win32com.client from the pywin32 package is required (https://github.com/mhammond/pywin32/releases). Be sure to download the proper pywin32 version according to your Python version.
Free and commercial versions
ARIS and the PBL have decided to make the DataProcessing Tool for ArcGIS 9.3 available for free to any other organisation. However it is not allowed to use or spread the free version tool in any commercial product. The DataProcessing Tool is released 'AS IS', without any warranty!
The DataProcessing Tool for ArcGIS 10.0 and later are not publicly funded anymore, so these versions require a license fee.
Interested? You can download an almost fully functional version, with a 5-day trial license for a specific ArcGIS version by clicking on the "Download setup" link or view the User's Manual in the table below.
If you decide to purchase this product, a key will be sent to you by email. This key will enable you to unlock the permanent license.
Note: The license for a specific 4.x version is valid for any 4.x version.
|4.6.6||ArcGIS 10.6||Manual||Download setup||Buy|
|4.6.5||ArcGIS 10.5/10.5.1||Manual||Download setup||Buy|
|4.6.4||ArcGIS 10.4/10.4.1||Manual||Download setup||Buy|
|4.6.3||ArcGIS 10.3/10.3.1||Manual||Download setup||Buy|
|4.6.2||ArcGIS 10.2/10.2.x||Manual||Download setup||Buy|
|4.5.1||ArcGIS 10.1||Manual||Download setup||Buy|
|4.2.1||ArcGIS 10.0||Manual||Download setup||Buy|
|2.2.0||ArcGIS 9.3||Manual||Download setup||Free|