Uploading Data with the Force.com Bulk API
August 12th, 2010
My article How to Load Large Data Sets with the Force.com Bulk API went up on developer.force.com yesterday. It shows how you can load data into Salesforce using the Bulk API either from a spreadsheet or directly from a database. You can find the code for the article at the code share project. Here’s an abstract from the article…
“Loading very large sets of data is becoming a common task for implementations, integrations and ongoing support. The standard Force.com Web Services API requires developers and administrators to implement complex processes to upload data in bite-sized chunks, monitor results and retry failed records. This method is acceptable for small loads of data but becomes unwieldy and time-consuming with large data sets that sometimes require numerous man-hours and multiple computers to operate in tandem.
The new Force.com Bulk API was designed specifically to offload the complex and time consuming process of importing large data sets from your client application to the Force.com platform. The Bulk API and supporting web interface allows you to upload and create import jobs, monitor and manage these jobs through an easy to use web interface, and receive notifications when the jobs complete. A few client applications already support the Bulk API but we’ll develop our own Java command line application that uses the Bulk API to upload large sets of data from a CSV file and database. This application can then be used as a starter for your own custom bulk data loader.”
You can read the entire article here.
Categories: Salesforce
Very good tutorial Jeff. I haven’t used bulk api yet. But I guess I’ll try it in my dev environment.
Nice tutorial. I think bulk data loading can be very useful if you are trying to build a SAAS application on force.com but still need to analyze large sets of data with dedicated algorithms and processes. One good example of that is the case of website analytics. We used Amazon to power all the data crunching. We started before force.com was available but would have considered it if we were starting today. http://www.yanivnizan.com/2010/08/forcecom.html