Commit Graph

45 Commits

Author SHA1 Message Date
8606a90e34 Optimize imports, fix up tracking records and time overall 2025-06-19 11:15:04 -04:00
a97819f4a6 Clean up old historical data calcs/scripts, optimize calculations to not update every row every time 2025-06-18 15:13:31 -04:00
80ff8124ec Update calculate scripts and routes for PO table split 2025-04-12 17:07:43 -04:00
8508bfac93 Add receivings table, split PO import 2025-04-12 14:20:59 -04:00
a4c1a19d2e Try to synchronize time zones across import 2025-04-05 16:20:43 -04:00
97296946f1 Clean up, fix file path issues with import scripts, adjust data management page for new metrics calcs 2025-04-01 00:15:06 -04:00
796a2e5d1f Add new metrics route 2025-03-30 11:43:29 -04:00
047122a620 Add new calculate scripts, add in historical data import 2025-03-30 10:30:13 -04:00
f4854423ab Update import tables schema with minor changes, add new metrics schema 2025-03-29 16:46:31 -04:00
957c7b5eb1 Add new filter options and metrics to product filters and pages; enhance SQL schema for financial calculations 2025-03-27 16:27:13 -04:00
108181c63d Fix more import script bugs/missing data 2025-03-25 22:23:06 -04:00
87d4b9e804 Fixes/improvements for import scripts 2025-03-24 22:27:44 -04:00
75da2c6772 Get all import scripts running again 2025-03-24 21:58:00 -04:00
675a0fc374 Fix incorrect columns in import scripts 2025-02-18 10:46:16 -05:00
ca2653ea1a Update import scripts through POs 2025-02-17 22:17:01 -05:00
a8d3fd8033 Update import scripts through orders 2025-02-17 00:53:07 -05:00
702b956ff1 Fix main import script issue 2025-02-16 11:54:28 -05:00
9623681a15 Update import scripts, working through categories 2025-02-14 13:30:14 -05:00
2d0089dc52 Incremental import order fixes 2025-02-01 11:03:42 -05:00
50b86d6d8a Fix/add data to PO script 2025-02-01 10:51:47 -05:00
1c932e0df5 More import script updates and fixes, better import_history tracking 2025-01-31 13:12:43 -05:00
a867117c3c Import script incremental fixes 2025-01-31 11:12:38 -05:00
996d3d36af Streamline incremental imports 2025-01-31 10:01:50 -05:00
d0abe9d9a2 - Modify import scripts to handle edge cases with empty arrays and null conditions
- Improve parameter handling in incremental update queries for purchase orders and products
2025-01-31 01:50:21 -05:00
5e4d1c3bd8 Improve import scripts with enhanced incremental update tracking and performance
- Add record tracking for added and updated records in import scripts
- Modify products import to use a dynamic 'needs_update' flag for selective updates
- Enhance order import with more comprehensive timestamp checks
- Update import-from-prod.js to handle and clean up previously running imports
- Improve error handling and connection management in import processes
2025-01-31 01:39:48 -05:00
b506f89dd7 Optimize order and product import scripts with improved performance and incremental update handling
- Refactor orders import to use temporary tables for more efficient data processing
- Improve batch processing and memory management in order import script
- Update product import to use temporary tables for inventory status
- Modify purchase orders import to use updated timestamp for incremental updates
- Enhance error handling and logging for import processes
2025-01-30 21:13:53 -05:00
c433f1aae8 Enhance import scripts with incremental update support and improved error handling
- Update import-from-prod.js to support granular incremental updates for different import types
- Modify orders.js to handle complex order data retrieval with better performance and error tracking
- Add support for incremental updates in products.js import function
- Improve logging and progress tracking for import processes
2025-01-30 15:49:47 -05:00
2b329a55a4 Increase product import batch size 2025-01-29 18:51:55 -05:00
fb5bf4a144 Optimize order import with improved tax info retrieval and performance 2025-01-29 18:21:31 -05:00
d2a2dbc812 Add incremental import support and tracking for database synchronization 2025-01-29 16:22:00 -05:00
d60b2d4fae Refactor import scripts with improved progress tracking and time formatting 2025-01-29 13:49:59 -05:00
84baa7e7d3 Break up prod import script into pieces and move csv scripts into folder 2025-01-29 13:28:15 -05:00
814d5d1a84 Break up prod import script into pieces and move csv scripts into folder 2025-01-29 00:18:04 -05:00
9c34e24909 Enhance metrics calculation scripts with improved progress tracking and cancellation support 2025-01-28 20:54:05 -05:00
ff1de4a37d Track import time 2025-01-26 23:39:01 -05:00
7c7c27a71c Sync up POs with receivings, fix and optimize PO import, show total time 2025-01-26 22:31:32 -05:00
5cbc2152a1 Finish getting POs working 2025-01-26 17:34:46 -05:00
48f09095c4 Get orders working correctly 2025-01-26 16:52:53 -05:00
cdce12e9fb Get orders import started, get all needed products imported 2025-01-25 21:43:31 -05:00
b1a5671531 Get product_categories inserting and product import fully running 2025-01-25 17:32:09 -05:00
2d52d7a63e Get product import started 2025-01-25 15:44:52 -05:00
c1cf78973d Product import fixes, more category import fixes 2025-01-25 15:24:51 -05:00
1694562947 Fix category import 2025-01-25 14:11:38 -05:00
e1174b8e63 Add route and frontend button to run import from prod script 2025-01-25 10:01:39 -05:00
353ae4540e Update schemas with new fields, create initial import from prod script 2025-01-25 09:45:50 -05:00