Google Sheets: Diff / Sync / Batch / Bulk update (Update Process in Google Sheets taking too much Operations)
planned
Vincent Mamet
I need to update twice daily a certain amount of google sheets with data from csv generated and saved on my website ftp folder.
The issue is that the amount of line to process is 40000 x 2 = 80000 lines per week and growing every day.
The issue is that the update cell in the module actually overwrite all the line instead of changing the modified one and adding the new one.
So it count 80000 operations per week instead of maybe 1000 operations per week.
Therefore, the app is not cost effective for my need.
If a analysing module could compare the CSVs and the Google Sheets without using operations and then update the 1000 lines, then it would count 1000 operations .... the app would be worth it !
---------------------------------------
BESTPRACTICE: You could use "Google Drive > Update a file" module, but it would update the whole spreadsheet.
Log In
Michal Zlatos
planned
Jouher
🚀Now start saving 1000s of operation. Yes, we have just released Google Sheet (Batch) Custom App.
Here are the Features:
✅ Batch Update of data
✅ Batch Append of data
✅ Batch Clear of rows
✅ Sort Data
✅ Format and Align Header
Video Link:
Grab the app for just $49 (for the first 10 users)
Coupon Code: MSQUARE49
Start 3-day free trial using the below link:
Michal Máša
Dear Integromates,
Last month we released the universal "Google Sheets > Make an API Call" module, which may help you to achieve the functionality you have requested as it allows you to invoke any Google Sheets REST API endpoint - https://developers.google.com/sheets/api/reference/rest
The module's documentation is available here: https://support.integromat.com/hc/en-us/articles/360012792513#make-an-api-call
You can see what modules and templates are available for the Google Sheets app here: https://www.integromat.com/en/integrations/google-sheets
The app’s documentation is available here: https://www.integromat.com/en/kb/pkg/google-sheets/index.html
Please, check it out, test it and let us know if it works as expected.
Should you have any questions, please contact our support (https://www.integromat.com/en/ticket) or feel free to post a question to our Facebook Integromat Community group (https://www.facebook.com/groups/integromat/), where hundreds of specialists, users and fans are willing to help.
Happy Automating!
Thanks,
The Integromat Team
Fred
Hello, any doc to read what we need to do to generate a file than update a sheet? Or, is it possible to convert a json to a file than use? I'm confusing what I need to do to use the WORKAROUND: "Google Drive > Update a file". Thanks.
Michal Máša
Darpan Gogia: You may use "Google Drive > Update a file" module, though it will update/overwrite the whole spreadsheet (not just a single worksheet).
Michal Máša
P.S.: You could use "Google Drive > Update a file" module, but it would update/overwrite the whole spreadsheet (not just a single worksheet).
Michal Máša
Do I understand correctly that what you are asking is "Google Sheets > Diff" module with the following input:
- a CSV file
- a GS worksheet
- assignment of CSV columns to the worksheet columns (used to compare the content of CSV lines with GS rows)
- name of the keycolumn in the CSV file (used to find matching rows)
The module would:
- Fetch all the rows from the given worksheet.
- For each line from the CSV file it would attempt to lookup the corresponding row from the worksheet by the key.
- IF there is a corresponding row THEN
3.1. It would compare values of the CSV line with the GS row,
3.2. IF there is a difference in at least one column THEN the module would output the CSV line with a tag
UPDATE
.- ELSE (there is no corresponding row) the module would output the CSV line with a tag ADD.
(and all that would consume just a single operation)
Am I correct? :)
Michal Máša
You could use "Google Drive > Update a file" module, but it would update the whole spreadsheet.