Extract Documents from Database
in Future-Proof Markdown Text
Project Background
The client database allows saving long-form text in a field as a “document” in standard textual markdown format, but these saved documents are available only in the database, as a data field. It is best if they are extracted from the database regularly, to make them “future proof” and accessible as actual text files, and allow them to be placed into source code version control.
| Project Aspect | Note |
|---|---|
| Organization Type | IT Services Firm |
| Completion Date | 12 Sep 2018 |
| Team Members | 2 |
| Users | 10 |
| Project Duration | 1 |
| Project Effort | 1 |
| Sites | Tokyo Office, US Datacenter |
Challenges
- Markdown text documents are stored in a database long text field, and while the db is being backed up, the documents are not accessible as separate files.
Solutions
- Develop a script to extract the documents as text files, and commit them to git source code version control.
Benefits
- Documents available as simple markdown formatted text files can be easily migrated to other systems.
- Storing text documents in a source code version control system like git, allows changes to be tracked as “diffs”.
Technologies
- Microsoft SQL
- Shell script using “jq” json manipulation utility
- cron for scheduling
Request More Information
Can eSolia help your firm with a project like this? Please contact us today.
