Commit Graph

  • 189dfdad3f Added some statements to deduplicate project descriptions master dtookey 2022-05-12 09:36:00 -0400
  • 361da98ad2 added email addresses to the engineering contribution table dtookey 2022-04-29 09:13:37 -0400
  • 7d702c9719 cleaning up MORE typos from refactoring dtookey 2022-04-20 13:09:16 -0400
  • f9ce3b899f cleaning up typos from refactoring dtookey 2022-04-20 13:04:54 -0400
  • 01cf9697d2 tweaked column names. hope this doesn't bite me dtookey 2022-04-20 12:57:38 -0400
  • 221ddd411b Fixed a typo in a query for contributions.sql dtookey 2022-04-20 12:10:51 -0400
  • 40b2a32418 tidied up some sanitize stuff. dtookey 2022-04-20 12:01:45 -0400
  • 5512550dc2 wait, did i break everything with a bad variable name? dtookey 2022-04-20 11:34:22 -0400
  • 4b5344f321 Revert "removed the where statement for @soil_techs in contributions.sql. I have a script on the company directory that updates a Google sheet with all the dept/division info in it. I think we'll do a join on the data in order to constrain it inside Datastudio." dtookey 2022-04-20 11:16:04 -0400
  • 50b49e0657 Revert "removed begin/end block that was throwing errors" dtookey 2022-04-20 11:16:01 -0400
  • 5453cc0c31 Revert "removed technician classification since we can get that table from google sheets" dtookey 2022-04-20 11:15:43 -0400
  • 48dc463cd4 Revert "cleaned up 1-sanitize_init.sql" dtookey 2022-04-20 11:15:41 -0400
  • 8c0115871b cleaned up 1-sanitize_init.sql dtookey 2022-04-20 10:58:22 -0400
  • e3a13374db removed technician classification since we can get that table from google sheets dtookey 2022-04-20 10:55:04 -0400
  • 21b3bf3aa4 removed begin/end block that was throwing errors dtookey 2022-04-20 10:51:31 -0400
  • 8846cb4287 removed list of field tech emails. dtookey 2022-04-20 10:46:03 -0400
  • 4db0e8dd14 removed the where statement for @soil_techs in contributions.sql. I have a script on the company directory that updates a Google sheet with all the dept/division info in it. I think we'll do a join on the data in order to constrain it inside Datastudio. dtookey 2022-04-20 10:37:47 -0400
  • 3df0ed1ab9 added table for rdu_soil_contributions. dtookey 2022-04-15 17:07:04 -0400
  • 8ac07dea51 Yep, sure was a syntax error. dtookey 2022-04-15 16:57:52 -0400
  • 8d42c8d3af Yep, sure was a syntax error. dtookey 2022-04-15 16:56:35 -0400
  • 61fe941d68 Import isn't going well. There's an issue with the CREATE TABLE syntax in contributions.sql dtookey 2022-04-15 16:55:06 -0400
  • 25128ae538 removed debug select from contributions.sql dtookey 2022-04-15 16:52:30 -0400
  • 874c349eb2 Deduplication complete! dtookey 2022-04-15 16:47:42 -0400
  • 7b94b13f61 Deduplication complete! dtookey 2022-04-15 16:40:24 -0400
  • 34400dacc3 I think I have the engineering contributions report deduplicated. dtookey 2022-04-15 16:37:53 -0400
  • 7de71948c3 corrected a bunch of timestamps in order to improve local-time accuracy. dtookey 2022-04-15 15:22:19 -0400
  • 3ec8ffbef2 Tweaked timestamps in project_lifecycle in order to shift it down 4 hours to local time from UTC. I guess this project officially doesn't recognize Standard Time. dtookey 2022-04-15 15:02:05 -0400
  • 194cbd64af first attempt at speeding up execution time of 1-sanitize_init.sql dtookey 2022-04-15 14:03:58 -0400
  • cb15790501 simplified sanitizing created project events in project_lifecycles. dtookey 2022-04-15 14:01:35 -0400
  • 78bbd9a706 The finalization pass was a dumb idea. We'll just put the per-table/concept sanitization in their file. We need these to happen before the other scripts run because we denormalize the data for performance. dtookey 2022-04-15 13:58:50 -0400
  • efbe425e35 Accidentally included a debug select in here with no terminating delimiter. dtookey 2022-04-15 13:46:56 -0400
  • 77bb9b9d6a introduced a sanitization pass at the very end of the import. dtookey 2022-04-15 13:20:10 -0400
  • 65423f0207 tweak to contributions.sql to use table alias dtookey 2022-04-15 12:14:52 -0400
  • 8cfc26b68b added work type descriptions dtookey 2022-04-15 12:03:44 -0400
  • ed6bb0ace1 tweaked the import script a little to make the output more clear dtookey 2022-04-15 11:38:23 -0400
  • eb456449d2 first attempt at contribution metrics dtookey 2022-04-15 11:28:33 -0400
  • d6048d4f45 Added todo to all_projects.sql dtookey 2022-04-13 16:44:01 -0400
  • 9d6e346f67 added created to lifecycle times dtookey 2022-04-12 16:21:25 -0400
  • 0cdc75925a first stab at durations.sql dtookey 2022-04-12 16:08:46 -0400
  • d46852cd9a added client name to billing report dtookey 2022-04-08 15:49:52 -0400
  • 3ffa03f765 added clients into billing report info dtookey 2022-04-08 15:43:45 -0400
  • b85f83bb6a added prefix to event_counts in order to concat the division info later. dtookey 2022-04-08 14:34:58 -0400
  • 217e833756 The issue appears to be the division prettification in lifecycle.sql. Changed it to simply grab the project type, we can grok the division info in datastudio dtookey 2022-04-08 14:28:12 -0400
  • b8b74efca2 changing import script to have a bit better resolution into what's running dtookey 2022-04-08 14:24:55 -0400
  • 6b1fc9bcc8 changing import script to have a bit better resolution into what's running dtookey 2022-04-08 14:22:39 -0400
  • 2e84d53a05 we're up to the hail mary portion of the initial setup. dtookey 2022-04-08 13:54:44 -0400
  • 6173e8e774 added index to billing for reference numbers to hopefully speed up query times. dtookey 2022-04-08 12:06:27 -0400
  • 022e7bbee6 removed data-reformatting in billing.sql dtookey 2022-04-08 12:04:00 -0400
  • 2d6a190cff trying to add an index to billing_report to see if that alleviates any long-query issues. dtookey 2022-04-08 11:46:34 -0400
  • ab8defde4d Found the bug. there was no delimiter at the end of billing.sql dtookey 2022-04-08 11:43:48 -0400
  • 0fadeef609 added new lines to try and avoid a weird import bug dtookey 2022-04-08 11:42:52 -0400
  • f647382b90 Forgot a drop if exists in 0-functions.sql dtookey 2022-04-08 11:41:24 -0400
  • 0fec39392a apparently calling functions is SUPER slow dtookey 2022-04-08 11:40:22 -0400
  • d3fb3c3038 Renamed 1-sanitize.sql in order to remove user tokens and whatnot before the slow queries. dtookey 2022-04-08 11:33:56 -0400
  • 6d65d76fb2 first round of billing.sql is finished. It runs a bit slow and it de-normalizes the data, but I think it's relatively 'safe' dtookey 2022-04-08 11:30:16 -0400
  • e3ee6e286d Updated the event_counts table in lifecycle.sql to collapse warranty projects down into Soils/Str instead of Soils/Str/Warranty dtookey 2022-04-08 10:08:03 -0400
  • 94206477cb changed formatting in sanitize.sql to use uppercase sql keywords. dtookey 2022-04-08 09:56:26 -0400
  • fea7142f45 updated sanitize.sql to run on stale data dtookey 2022-04-08 09:54:37 -0400
  • 4fa8a33b1a Tweaked all_projects.sql to run on stale data. dtookey 2022-04-08 09:53:18 -0400
  • 9f300305c5 added division column to the event_counts table in lifecycle.sql. dtookey 2022-04-08 09:52:09 -0400
  • a551f9321c added first round of lifecycle processing. added minor lifecycle cleanup to sanitize.sql. dtookey 2022-04-07 14:28:51 -0400
  • 14497754f5 first round of all_projects table generation. this is entirely hardcoded, so it ain't future proof. We need a way to do this programmatically. dtookey 2022-04-07 13:11:38 -0400
  • 1106b38346 cleaned up import.sh to have a bit better flow (also trying to troubleshoot ```./update-datastudio: line 5: /home/clarity: Is a directory```) dtookey 2022-04-07 09:08:54 -0400
  • 37a9a0ec52 cleaned up import.sh to have a bit better flow (also trying to troubleshoot ```./update-datastudio: line 5: /home/clarity: Is a directory```) dtookey 2022-04-07 09:08:17 -0400
  • b0030323a7 better way of handling gluing *.sql scripts together in import.sh dtookey 2022-04-06 16:23:57 -0400
  • 1ed99c5ef9 tweaked import.sh to make the linter a bit more happy dtookey 2022-04-06 16:01:39 -0400
  • 3f8cd57183 basic proof of concept. just need it to run tonight dtookey 2022-04-06 15:59:29 -0400
  • 78a441ff9e changed proof to import.sh. this is just going to make it clearer which direction to proceed tomorrow dtookey 2022-04-06 15:49:06 -0400
  • a8409692e2 adding a proof script to make sure the automation works correctly dtookey 2022-04-06 15:46:28 -0400
  • c0a0e29df1 initial commit dtookey 2022-04-06 15:05:34 -0400