The NuoDB Migrator for Moving SQL Data to a NoSQL Database
Description
NuoDB is a NewSQL database platform with a unique geo-distributed database management system. It provides linear scalability, outstanding scale-out performance, continuous availability and can run anywhere—in a local data center, in multiple data centers around the world, or in the cloud. With support for multiple platforms, users are able to build hybrid solutions that have both Linux and Windows hosts.
The customer
Launched in 2010 by industry-renowned database architect Jim Starkey and accomplished software CEO Barry Morris, NuoDB has become the leading distributed database management system. The company is the recipient of numerous, prestigious industry awards including the Gartner Cool Vendor and the Red Herring Top 100. Used by thousands of developers world-wide, NuoDB’s customers include automotive after-market giant Autozone, NorthPoint Solutions, Fathom Voice, Platform 28 and other innovative organizations.
The need
Historically, data migration has been difficult because of the risk of data loss, differing document structure, data integrity damage, and the significant time investment required. NuoDB partnered with Altoros to address these inconveniences and offer a NuoDB Migrator to enable enterprises to easily transfer their SQL databases to a modern geo-distributed database—as well as keep their SQL and NewSQL data stores synchronized. The system needed to be flexible enough for a broad range of user source database conventions, and fast and efficient enough to get the job done without a loss of productivity.
The challenges
The NuoDB Migrator, developed by Altoros, enables users of traditional SQL databases, such as Microsoft SQL Server, Oracle, MySQL, PostgreSQL, IBM DB2, Sybase Adaptive Server, and others to easily migrate their data to NuoDB. The system transforms data according to the structure of your a source database and provides simple dump and load methods. The data is migrated in a way that enables preservation of data integrity and relations between objects of the source database, while at the same time guaranteeing compliance with the objects used in your NuoDB database (domains, sequences, users, roles and grants, views, triggers, constraints, etc.).
The solution
The NuoDB Migrator enables users to extract data from SQL-compliant databases and load it to NuoDB. The tool is able to manage large data processing scenarios, such as failures, continuation, restart and catch-up. During operation, completion status is displayed for task execution and users are provided detailed reports on the migration process. The functionality of the tool can be easily extended with other ETL plugins or tasks. Users can work with the system through a command console and the Migrator contains a help section with all commands described. The Altoros team provided the ability to make a copy of the database and deploy it elsewhere to enable users to test the solution or to modify it as needed, e.g. in a proof-of-concept. Altoros also contributed to the development of the Tungsten Replicator for NuoDB. This additional tool allows users to keep different versions of a database synchronized, parallelizing data flows as well as completing other operations with data. These two components of the NuoDB platform combine to enable users to easily and quickly migrate data to their databases.
The outcome
While many enterprises would prefer to move to scalable NewSQL databases like NuoDB, the difficulty of data migration has held back progress. But with NuoDB Migrator and NuoDB Applier for Tungsten Replicator—developed by Altoros—it is now easy to jump on board with NuoDB’s geo-distributed database. The NuoDB Migrator is cross-platform and ensures a high level of data consistency and integrity, eliminating the old complications of data migration.
Technology stack
Server platform
Unix, Linux, Windows, MacOS
Programming languages
Java 6
Technologies
JDBC, Maven, Git, Travis, BSON, CSV, XML
Databases
NuoDB, MySQL, PostgreSQL, MSSQL, Oracle, NoSQL
Development Environment
IntelliJ IDEA
Contact us
Jan-Terje Nordlien
Daglig leder
jan-terje@altoros.no+47 21 92 93 00Altoros Norge AS
Org.nr.: 894 684 992
Tordenskiolds gate 2,
0160 Oslo