52 Commits (master)
 

Author SHA1 Message Date
dtookey 2c92a99f58 cheap hack for preserving some lifecycle information for the moriarty project 2 years ago
dtookey 1cb6ee49e4 Added a review_contributions table for the different reviewed statuses 2 years ago
dtookey e37c1e3a34 Added a review_contributions table for the different reviewed statuses 2 years ago
dtookey 08e3aaafe3 Added a review_contributions table for the different reviewed statuses 2 years ago
dtookey 3b0cb09fbb scoured out all_projects 3 years ago
dtookey bdd97bcae9 updated data structures to hopefully match clarity 3 years ago
dtookey b5de485fa3 tweaks to all projects view construction. - happy new year 3 years ago
dtookey 7cf9b6cca8 fixed weird issue with timesheet reports 3 years ago
dtookey 9a1adf6bd3 tweaks to all projects view construction. - happy new year 3 years ago
dtookey 72e50e3e49 tweaks to all projects view construction.
change to paycor hours to eliminate need for joining inside of looker
3 years ago
dtookey cab8898dd0 tweaks to all projects view construction. 3 years ago
dtookey 331867ee4e added wilmington to clarity vitals 3 years ago
dtookey 2958b3124e literally one line of function documentation... 3 years ago
dtookey f3446b5c08 cleaned up some procedure logic in paycor.go and added documentation to csvWorker.go 3 years ago
dtookey a87213d98f basic pipeline from the driver project through to the database at data-connect is working. 3 years ago
dtookey 5c63b01fb6 migration from legacy report to new report hours are complete. 3 years ago
dtookey 11d3ca3e6d new interface/worker to accelerate csv parsing. define the struct, write a mapping function, and baby -- you got a stew goin'. 3 years ago
dtookey b6d9f3e9fd data structures for the new timesheet reports are created and the parsing logic should be okay. still need to test for typos/bugs 3 years ago
dtookey 8e6a2f376d first draft of timesheet reports.
still need to modify all existing reports to match up to the schema of what's actually coming out from HR lately.
3 years ago
dtookey bc0c38745d added failed review checking to table reset logic. 4 years ago
dtookey e6798bb339 tweaked script formatting 4 years ago
dtookey 8a64255a89 added view for project kickbacks 4 years ago
dtookey 3a48e7e033 fixed Account receivables report.
Improved MANY insertion times by rolling up large insertions into large generated queries (sorta dangerous)
4 years ago
dtookey 5e28da9c17 Added Blocker (for turning objects into 'blocks' of query text) interface in database-primitives.go
along with an ExecuteString method for *ConnectorGenerics that will take a file name and run a concatenated query.
This VASTLY improves insert times.

Added a hackey pseudoinit function into Interconnect.go in order to get access to a database without all the headache and time of recreating all the tables.

Updated verizon.go to use the new query functions
4 years ago
dtookey 6fd8e8bd39 Added some status Printlns.
Added parametric header skipping in processTrialBalance in csv.go.
Began earnest work on a sustainable verizon pipeline.
4 years ago
dtookey 791ca84414 Removed debugging lines from GetTimeAllTimeEntriesForUserThroughDate, but kept the non-200 response code debugging line.
Modified insight-connect.go to only capture time entry data from engineering users.
Added line for updating some finance info into the main mercury.go routine, but it's commented out until the delivery pipeline gets sorted out.
4 years ago
dtookey c7e92d9fa0 added some debug printing to the logs.
Swapped the order of some things in 1-sanitize_init.sql in hopes to speed up the import/processing times.
4 years ago
dtookey 909509d2c5 fixed a bone-headed mistake naming the files. hopefully the symptom was corrected. I'll get to work on the cause. 4 years ago
dtookey 05e21fda8e migrated the sql scripts from the clarity-vitals project 4 years ago
dtookey d36464aa8a AR aging reports can be scanned from a file and updated on the datastudio server. However, this is a highly-manual process. we need to work on automation next. 4 years ago
dtookey f7b56120ea refactoring lead to a successful run. However, when running from my home computer, the insight update took approx. 25 minutes. We should add some benchmarking features tomorrow and get a better sense of how long runs actually take. 4 years ago
dtookey e5924caefc changed "DBConnectorGeneric" to "ConnectorGeneric" to avoid clashing with the package name. 4 years ago
dtookey 71552ec88e renamed "util" package to "db" to better reflect the fact that's all that the package does. It also makes site calls to things such as db.BulkUpdate() much more clear. 4 years ago
dtookey 96f4eae410 SQL scripts that mostly handle the administration of databases and tables has been moved into database-primitives.go, and executed via the "runner" pattern that we came up with. 4 years ago
dtookey 1a16e1ba38 tweaked one function call to be uppercase. 4 years ago
dtookey 26c4ba93d3 beginning work on picture timestamp correlation 4 years ago
dtookey dc6ba5a8ce debugging finished. we are back to pre-refactor parity 4 years ago
dtookey f48bde1e61 Debugging new schema 4 years ago
dtookey e40a72f38e refactoring of the database is complete and a lot more clean. It is currently untested, so we'll kick off the inaugural scan here in a minute. 4 years ago
dtookey f1a149ee52 updated gitignore 4 years ago
dtookey 019c9f16d7 removed a hard coded date string in the UpdateTimeEntries method on the Interconnect struct 4 years ago
dtookey 9246c1a5bb replaced all error-fed fatal logs with errors instead of fatalln 4 years ago
dtookey fb4c7f7bbb The mercury binary is now deployable and *should* run every morning at 2am 4 years ago
dtookey 400d65b58f changed the insight scraper to get all data for every person, and then create the engineering_contributions table by filtering against clarity user info 4 years ago
dtookey 7be29424a9 engineering contributions are in a much better, simpler place. 4 years ago
dtookey accade8dff we have the first round of engineering time from insight in the reports 4 years ago
dtookey 49e6b7bb73 created abstractions for automatically pulling users and time entries for users. We haven't completed a full successful (the description field in TimeEntry failed at varchar(512), so we've upped it to 4k) run. However, it's currently running and has gotten past the initial hiccup. 4 years ago
dtookey 7a3f678aa9 initial processing for Trial Balances. 4 years ago
dtookey 8e105637e3 started work on transferring information to the data-connect database 4 years ago
dtookey c776278913 started work on a library for pulling project insight data 4 years ago