Quickly Import Large CSV Files Into MySQL

- July 12, 2009, 6:56 pm | Working With Data

Add to del.icio.us | Digg

---

How many times have you tried importing large amounts of data into a MySQL database. How many 300 Second timeouts have you gotten? If you are using PhpMyAdmin, not only is it a race to get the program to import 100,000+ records, but you have the upload time to consider. 

Import data in seconds with the Z Quick Import Tool.

In the past we have used BigDump: Staggered MySQL Dump Importer to help import large data files. It does the job by staggering the import so you do not get server memory issues, or a PHP timeout error. But even this took a lot of time.

That is when we developed the Z Quick Import Tool. We regularly deal with databases and CSV files that have 1,000,000+ records, and even using BigDump we would spend hours waiting for a single import.

Using a real life example, we tested the Z Quick Import Tool on our California and New York Business Databases. Each of these databases contain over 2,300,000 records. Our test server was a VPS with just 512 Mb or Ram. So it would be difficult to find a weaker server. In ten tests the average time to import either of these databases was just 51 seconds. No test exceeded 00:01:10.

Now we use our Z Quick Import Tool several times a day.

This program is written in PHP and was designed to work on any server running PHP and MySQL.

When you purchase a database from us, send us an email and tell us you read this article and we will give you a free copy of the Z Quick Import Tool. And when you realize how much time we have saved you come back and buy some bigger databases!

---

Z Quick Import Tool



Keywords: database import csv mysql php

---

Recently Added:

1. Problems With Variables Not Being Passed To A Page - Coding Tips
2. 12,000,000 Page Web Site - 12 Million Page Web Site
3. Converting CSV Files To SQL The Easy Way - Working With Data
4. Mod Rewrite For SE Friendly URLs A Practical Example - Coding Tips
5. Read This Before You Buy A Database - Database Notices

Copyright © 1993-2009 USPN Tech, All Rights Reserved