Database Mapping Archives

Tag Archive for: Database Mapping

MapForce Data Mapping Tutorial (Video)

April 4, 2022/in Data Integration, Database, EDI, JSON, SQL, XML /by Ty Shuff

Altova MapForce is an any-to-any data transformation, conversion, and ETL tool for integrating data.

A graphical data mapping tool, MapForce has an intuitive drag-and-drop interface that lets you easily convert data between any two formats, such as XML, JSON, relational databases, NoSQL databases, EDI, and more. It also features an extensive library of conversion functions that can be chained together to form custom functions that can be reused throughout your projects.

Data translated by MapForce can be pulled to or pushed from a relational or NoSQL database and all data management products, and it can be adapted to customize in-house data management solutions.

The MapForce tutorial video below covers all major features offered by the data integration tool and shows example mappings between several different types of files.

You can try MapForce yourself with a free, 30-day trial.

Tags: data integration, data mapping, Database Mapping, JSON mapping, MapForce, MapForce Server, XML JSON

New Data Integration Tools

March 25, 2020/in Data Integration, Database, EDI /by Erin Cavanaugh

Altova MissionKit tools offer numerous ways to connect to, query, and integrate data from disparate sources. With multiple product releases each year, we’re constantly working to deliver increased power and efficiency for data integration, while adding features requested by customers. This includes ongoing updates to built-in support for all major SQL databases across the product line.

Let’s take a look at some of the recently added tools and enhancements.

New data integration tools in Altova's release

Data Mapping JSON Lines

February 24, 2020/in Data Integration, Database mapping, JSON /by David McGahey

The JSON data format continues to evolve as an open standard as it is creatively applied to new data interchange requirements. JSON Lines, defined at http://jsonlines.org/, is a convenient text format for storing structured data where each record is a single line and a valid JSON object. JSON Lines handles tabular data and clearly identifies data types without ambiguity. This allows records to be processed one at a time, which makes the format very useful for exporting and sending data.

Altova MapForce supports data mapping JSON Lines as either a data source or target. Let’s look at a mapping project to extract records from a database table and map to a JSON Lines file for output.

Transitioning Data Mapping Projects from Development through Testing and Production

November 29, 2019/in Data Integration, Database mapping, Servers, Software /by David McGahey

Data mapping projects often mirror software development efforts with distinct phases for design, testing, and deployment. This is especially true for ETL (Extract Transform Load) projects when repeated data mapping execution is required as new data becomes available, and the stakes increase higher with large data sets. The Altova MissionKit and Server Software products provide Global Resources to define configurations for each project phase and smoothly transition between them.

Let’s take a look at an example based on a MapForce data mapping from a source file to a database.

Database Mapping with Database Exception Handling

June 5, 2019/in Data Integration, Database, Database mapping /by David McGahey

Critical business processes depend on reliable data and database administrators and other data analysts want to be confident in the integrity of information stored in database tables. During automated ETL (Extract Transform Load) operations or other database import tasks, invalid data might be encountered that jeopardizes success of the procedure. Altova MapForce includes database exception handling to roll back the affected data when an error occurs and optionally proceed with the rest of a database mapping.

For instance, an error in a single record need not prevent execution of a mapping from continuing, such as when certain database constraints prevent the mapping from inserting or updating invalid data.

Database Tracing to Log Changes Made by a Data Mapping Project

May 1, 2019/in Data Integration, Database, Database mapping, Database tracing /by David McGahey

Database administrators and other data professionals often want to maintain a record of changes in critical databases, especially when updates are made by automated scripts or other operations. Database tracing lets administrators track critical changes or anomalies, and help recover from errors. Altova MapForce supports database tracing for all popular relational databases to log the changes made by a data mapping project to the database when the mapping runs.

When tracing is enabled, events such as database insert or update actions, or errors, are logged in an XML file that you can later analyze or process further in an automated way.

Database tracing can be enabled at the database component, table, stored procedure, or database field level. You can choose to trace all messages or only errors, or you can disable tracing completely.

In addition to tracing errors that occur during the execution of a mapping to a target database, MapForce also enables database transaction handling to roll back the affected part of the database data when an error occurs, then optionally proceed with the rest of the mapping.

MapForce Supports SQL Merge When It’s the Right Tool for the Job

November 1, 2016/in Data Integration, Tools /by David McGahey

Large database tables can easily contain a million, even hundreds of millions of rows of data. Database administrators and others charged with maintaining such large datasets are always concerned about execution time for ETL (Extract, Transform, and Load) operations, updates, and other SQL queries. To make these operations more efficient, some — but not all — database vendors implemented a SQL merge statement to insert or update rows of an existing table as a single bulk-insert statement rather than requiring individual statements for each row.

Altova MapForce automatically supports SQL merge when it is available for the target database. Let’s look at an example.

shutterstock_66084286