hugh/public_library_map
hugh/public_library_map
1
Fork 0
Code Issues 9 Pull requests Actions Packages Projects Releases Wiki Activity

Compare commits

base: hugh:main
Branches Tags
hugh:main
hugh:contribs
hugh:readme
hugh:test
..
compare: hugh:readme
Branches Tags
hugh:main
hugh:contribs
hugh:readme
hugh:test

No commits in common. "main" and "readme" have entirely different histories.
main ... readme

8 changed files with 19 additions and 85 deletions
Show stats Expand all files Collapse all files

35
README.md
View file

@ -16,41 +16,6 @@ See [sources](https://librarymap.hugh.run/sources).
See [contributing](https://librarymap.hugh.run/contributing/), especially *[which files to update](https://librarymap.hugh.run/contributing/#which-files-to-update)*.
## Deployment
The website for this project uses [git-webhooks](https://git.suboptimal.solutions/hugh/git-webhooks) with a customisation to run the `process.js` file that is found in this repository on each pull. The file is stored with the webhooks files so that everything can be `npm install`ed together.
This `process.js` file syncs any changes from the csv files into the topojson attributes (e.g. when a library changes their ILS).
## Updating the topojson
### Update boundaries
* make a copy of `/public_library_map/boundaries.geo.json`
* update in `qgis`
* save the copied file
### Simplify to reduce the file size
#### Option 1
* upload to https://mapshaper.org/ and 'simplify' the boundaries
* download the simplified version
* replace `/public_library_map/boundaries.geo.json`
#### Option 2
```bash
sudo npm install -g mapshaper
mapshaper boundaries.geo.json snap -clean -o force precision=0.0001 format=geojson boundaries.geo.json
```
### Turn it into `topojson`:
```bash
sudo npm install -g topojson-server
geo2topo boundaries.geo.json -q 50000 > website/data/boundaries.topo.json
```
## Contributing
To contribute to the map data you can contact Hugh at librarymap [at] hugh.run. If necessary, I will add an account for you on `git.suboptimal.solutions` if you want to contribute to the code.

35
process.js
View file

@ -1,35 +0,0 @@
import csv from 'csv-parser'
import fs from 'fs'
const data_directory = '/srv/public_library_map/website/data'
// read json file into memory
const mapData = fs.readFileSync(`${data_directory}/boundaries.topo.json`)
let data = JSON.parse(mapData)
let geometries = data.objects['boundaries.geo'].geometries
// read csv file
// 'data' should be a single line (excl headers)
fs.createReadStream(`${data_directory}/library_services_information.csv`)
.pipe(csv())
.on('data', (data) => {
for (let feature in geometries) {
if (geometries[feature].properties.name == data.name) {
for (let k in data) {
if (k != "long_name" && k != "") {
geometries[feature].properties[k] = data[k]
}
}
}
}
})
.on('end', () => {
// write back to object
data.objects['boundaries.geo'].geometries = geometries
// write back to file
try {
fs.writeFileSync(`${data_directory}/boundaries.topo.json`, JSON.stringify(data))
} catch (err) {
console.err('ERROR writing topo file')
}
console.log('topo updated')
})

2
website/about/index.html
View file

@ -23,7 +23,7 @@
<li class="active-tab">About</li>
<li><a href="/sources">Acknowledgements</a></li>
<li><a href="/contributing">Contribute</a></li>
<li><a href="https://git.suboptimal.solutions/hugh/public_library_map">Code</a></li>
<li><a href="https://github.com/hughrun/public_library_map">Code</a></li>
</ul>
</nav>
</header>

18
website/contributing/index.html
View file

@ -23,7 +23,7 @@
<li><a href="/about">About</a></li>
<li><a href="/sources">Acknowledgements</a></li>
<li class="active-tab">Contribute</li>
<li><a href="https://git.suboptimal.solutions/hugh/public_library_map">Code</a></li>
<li><a href="https://github.com/hughrun/public_library_map">Code</a></li>
</ul>
</nav>
</header>
@ -33,14 +33,16 @@
<p>I’d love your help to make <em>Library Map</em> as accurate and useful as possible.</p>
<h3 id="how-to-contribute-your-idea-bug-report-or-improvement">How to contribute your idea, bug report or improvement</h3>
<ol type="1">
<li>Look at the <a href="https://git.suboptimal.solutions/hugh/public_library_map/issues?q=&type=all&state=open&labels=9&milestone=0&assignee=0&poster=0">current issues tagged <code>help wanted</code></a> to see if you can help. Most of these will be to do with updating data, like finding street addresses or other information.</li>
<li>Email <code>librarymap</code>@<code>hugh</code>.<code>run</code> and ask me to open a <code>git.suboptimal.solutions</code> account for you, or just request that I fix/add something.</li>
<li>Look at the <a href="https://github.com/hughrun/public_library_map/issues?q=is%3Aissue+is%3Aopen+label%3A%22help+wanted%22">current GitHub issues tagged <code>help wanted</code></a> to see if you can help. Most of these will be to do with updating data, like finding street addresses or other information.</li>
<li>You can <a href="https://github.com/hughrun/public_library_map/issues">create a new issue</a> on GitHub.</li>
<li>You can <a href="https://docs.github.com/en/github/.collaborating-with-issues-and-pull-requests/about-pull-requests">send a pull request</a> — though it is <em>strongly preferred</em> that you either ask to be assigned to an existing issue (so everyone knows you’re working on it), or create a new issue, first.</li>
<li>You can just send an email to <code>librarymap</code>@<code>hugh</code>.<code>run</code> and ask me to fix/add something.</li>
</ol>
<h3 id="if-you-have-not-used-git-before">If you have not used Git before</h3>
<p>There is a class outline for an <a href="https://librarycarpentry.org/lc-git/">introduction to Git and GitHub aimed at librarians</a> at <code>librarycarpentry.org</code>. This assumes you are using the command line.
<h3 id="if-you-have-not-used-git-or-github-before">If you have not used Git or GitHub before</h3>
<p>There is a class outline for an <a href="https://librarycarpentry.org/lc-git/">introduction to Git and GitHub aimed at librarians</a> at <code>librarycarpentry.org</code>. This assumes you are using the command line. If you create or already have a GitHub account, you can also <a href="https://docs.github.com/en/github/managing-files-in-a-repository/editing-files-in-another-users-repository">edit files directly in the browser</a>, or use <a href="https://desktop.github.com/">GitHub Desktop</a> - both of which are probably less intimidating options if you don’t have any desire to learn how to use a command line/shell interface, or just want to make a single minor update.</p>
<h3 id="which-files-to-update">Which files to update</h3>
<p>To update information about library <em>services</em> (e.g. fines info, loan period etc) you should edit <code>website/data/library_services_information.csv</code>.</p>
<p>To update information about library <em>locations</em> (e.g. street address, phone number, coordinates) you should edit the relevant csv location file:</p>
<p>To update information about library <em>services</em> (e.g. fines info, loan period etc) you should edit <code>website/data/library_services_information.csv</code>.</p>
<p>To update information about library <em>locations</em> (e.g. street address, phone number, coordinates) you should edit the relevant csv location file:</p>
<ul>
<li><code>website/data/indigenous_knowledge_centre_locations.csv</code></li>
<li><code>website/data/mechanics_institute_locations.csv</code></li>
@ -54,7 +56,7 @@
<h3 id="missing-or-inaccurate-data">Missing or inaccurate data</h3>
<p>Currently we’re missing data for some library services in relation to <strong>standard loan periods</strong> and <strong>fines for overdue items</strong>. Any acurate and specific information about fines for South and Western Australia would be particularly helpful.</p>
<p>It’s likely that some <strong>library location data</strong> is inaccurate — especially for New South Wales. It’s also possible that the address data is wrong (even though the location shown may be correct), and in some cases it is missing.</p>
<p>It’s possible that some of the <strong>fines data for Queensland</strong> is a little off. This came from the State Library of Queensland but some of the data was wrong (e.g. Gold Coast Libraries does not charge overdue fines, but the SLQ report says it does).</p>
<p>It’s possible that some of the <strong>fines data for Queensland</strong> is a little off. This came from the State Library of Queensland but some of the data was wrong (e.g. Gold Coast Libraries does not charge overdue fines, but the SLQ report says it does).</p>
<p>I am particularly interested if you know of data sources for entire regions, states, or Australia — especially if they’re reliably kept up to date.</p>
<p>If you can fill in any of these blanks, please update the relevant CSV file and send a pull request. If your data is coming from somewhere in particular, you should also add that to <code>sources.md</code> in the relevant table.</p>
<h3 id="ideas-for-additional-data">Ideas for additional data</h3>

2
website/fines/index.html
View file

@ -25,7 +25,7 @@
<li><a href="/about">About</a></li>
<li><a href="/sources">Acknowledgements</a></li>
<li><a href="/contributing">Contribute</a></li>
<li><a href="https://git.suboptimal.solutions/hugh/public_library_map">Code</a></li>
<li><a href="https://github.com/hughrun/public_library_map">Code</a></li>
</ul>
</nav>
</header>

2
website/index.html
View file

@ -25,7 +25,7 @@
<li><a href="/about">About</a></li>
<li><a href="/sources">Acknowledgements</a></li>
<li><a href="/contributing">Contribute</a></li>
<li><a href="https://git.suboptimal.solutions/hugh/public_library_map">Code</a></li>
<li><a href="https://github.com/hughrun/public_library_map">Code</a></li>
</ul>
</nav>
</header>

8
website/sources/index.html
View file

@ -23,7 +23,7 @@
<li><a href="/about">About</a></li>
<li class="active-tab">Acknowledgements</li>
<li><a href="/contributing">Contribute</a></li>
<li><a href="https://git.suboptimal.solutions/hugh/public_library_map">Code</a></li>
<li><a href="https://github.com/hughrun/public_library_map">Code</a></li>
</ul>
</nav>
</header>
@ -42,9 +42,11 @@
<li>Andrew Kelly</li>
<li>Sonya Lange</li>
<li>Stephanie Schwarze</li>
<li>Sally Baker</li>
<li>Sally</li>
<li>Molly</li>
<li>Michaela Olde</li>
<li>hughrun</li>
<li>sallybaker</li>
</ul>
<h3 id="visualisation">Visualisation</h3>
<table>
@ -87,7 +89,7 @@
<p>The library service boundaries are derived from local government boundary data care of PSMA and accessed from <a href="https://data.gov.au">data.gov.au</a>.</p>
<p>Data about fines and lending periods is a mix of original research, plus data provided by State Libraries and Public Libraries Victoria.</p>
<p>Data about language holdings (TODO) provided by various sources.</p>
<p>Data about Integrated Library Systems (ILS) is mostly original research, with some data from State Library of Queensland, and some checked at Marshall Breeding’s <a href="http://librarytechnology.org">librarytechnology.org</a> site.</p>
<p>Data about Integrated Library Systems (ILS) (TODO - almost done) is mostly original research, with some data from State Library of Queensland, and some checked at Marshall Breeding’s <a href="http://librarytechnology.org">librarytechnology.org</a> site.</p>
<table>
<colgroup>
<col style="width: 33%">

2
website/who-else/index.html
View file

@ -23,7 +23,7 @@
<li><a href="/about">About</a></li>
<li><a href="/sources">Acknowledgements</a></li>
<li><a href="/contributing">Contribute</a></li>
<li><a href="https://git.suboptimal.solutions/hugh/public_library_map">Code</a></li>
<li><a href="https://github.com/hughrun/public_library_map">Code</a></li>
</ul>
</nav>
</header>