Getting data out of Salesforce in near-realtime

Learn the different ways to get data off the Salesforce platform in near real-time using both on platform and external solutions. In this session we covered the on the platform option like Outbound message, Apex Callouts, Salesforce connect and Off platform option like heroku Connect, Steaming Api, Change Data Capture, Polling.

Agenda

1. Overview
2. Definition of near real-time
3. On platform options
   1. Outbound Messaging
   2. Apex Callouts
   3. Salesforce Connect (External Data Source)
4. Off platform options
   1. Heroku Connect
   2. Streaming API
   3. Change Data Capture
   4. Polling (REST/SOAP)
5. Solutions for non real-time
6. Recap

On Platform Options

1) Outbound Messaging

Pros

• Automatic Retry
• No Code Required

Cons

• Order are Not Guaranteed
• No Guaranteed Timeframe
• Not Great with Large Data Volumes
• No Related Data
• Lack of Strong Security

2) Apex Callouts

Pros

• Flexible Data Types
• More Security Options

Cons

• Order are Not Guaranteed
• No Guaranteed Timeframe
• No Retry
• Difficult to Log Failures
• Governor Limits
• Must be in an @future call

3) Salesforce Connect (AKA External Data Source)

Pros

• Real-time
• Low Development Cost

Cons

• Cost
• Reliant On Endpoint Type
• Limited Write Capabilities

Off Platform Options

1) Heroku Connect

Pros

• Bi-directional Data Sync
• Fairly Turn-key

Cons

• Cost
• Might Be Overkill

2) Streaming

Pros

• True Realtime
• Message Reliability
• Message Durability

Cons

• Lots of Work
• Governor Limits Can Be Tricky

3) Change Data Capture

Pros

• True Realtime
• Message Reliability
• Message Durability

Cons

• No Related Data
• Lots of Work

4) Polling (REST / SOAP)

Pros

• Get Exactly What You Want
• Bundle Multiple Queries
• Large Data Ready

Cons

• API Call Limits
• Number of Records
• Datetimes Stored to Second
• Frequency

But what about…? Data Loader & Platform Event

• Platform events aren’t a way to get data out.  They could be used in conjunction with the Streaming API
• Data loader isn’t realtime

Here is recording of session:

Speaker         : Patrick Connelly
Date                : Saturday, 06 July, 2019 10:00 AM EST ( 7:30 PM IST

Please subscribe our YouTube channel to get notification for video upload.

Check our “Session in 2019” page for all upcoming and old sessions of 2019

1,331 total views, 14 views today