diarium

SQLite & web scraper tooling for work environment data

Modules

| Module | Description | | --- | --- | | Case | Referred to as an "ärende" by Arbetsmiljöverket. Each case contains one or more documents. Cases may also optionally have one company, county, municipality, and workplace. Many cases have all of these. Some have none. | | Company | Referred to as either a "företag" or an "organisation" by Arbetsmiljöverket. | | County | This is a "län" in Swedish. Sweden has 21 counties and Arbetsmiljöverket's data allows for a few other special cases outside that 21. Not all cases are associated with a county. | | Database | Code related to SQLite3 lives here. That means all the logic for reading from and writing to the database. | | Document | Documents are the protagonists of the diarium data model. Another appropriate English word for them would be "filings". Arbetsmiljöverket refers to them as "handlingar" in Swedish. | | Ingestion | High-level orchestration of several other modules is managed here in order to ingest Arbetsmiljöverket's data into SQLite. | | Municipality | This is a "kommun" in Swedish. There are 290 of these in Sweden. Just like with counties, Arbetsmiljöverket have a few special case values here outside the canonical 290 municipalities that actually exist in real life. | | Pagination | The web search results on Arbetsmiljöverket's site are paginated. This is the code for paging through those results to determine what documents exist for a given date. | | Time | What project is complete without a junk drawer of utility functions for date and time operations? | | Workplace | Referred to as an "arbetsplats" by Arbetsmiljöverket. Less interesting for companies with a single office or warehouse. More interesting in cases such as city ocuncils where one company might encompass hundreds of workplaces such as schools. |

License

MIT