barak/cayley
1
0
Fork 0
Code Issues Pull requests Releases Wiki Activity

Add transparent input decompression

Browse source 
This supports gzip and bzip2 by magic number determination.

Trailing whitespace differences in documentation due to opinionated
editor.
This commit is contained in:
kortschak 2014-07-19 12:49:55 +09:30
parent abdd649c82
commit 9bf09a5db5
7 changed files with 100 additions and 72 deletions
Download patch file Download diff file Expand all files Collapse all files

14
docs/Overview.md
View file

@ -1,6 +1,6 @@
# Overview
## Getting Started
## Getting Started
This guide will take you through starting a persistent graph based on the provided data, with some hints for each backend.
@ -25,22 +25,16 @@ You can repeat the `--db` and `--dbpath` flags from here forward instead of the
### Load Data Into A Graph
Let's extract the sample data, a couple hundred thousand movie triples, that comes in the checkout:
First we load the data.
```bash
zcat 30kmoviedatauniq.n3.gz > 30k.n3
```
Then, we can load the data.
```bash
./cayley load --config=cayley.cfg.overview --triples=30k.n3
./cayley load --config=cayley.cfg.overview --triples=30kmoviedata.nt.gz
```
And wait. It will load. If you'd like to watch it load, you can run
```bash
./cayley load --config=cayley.cfg.overview --triples=30k.n3 --alsologtostderr
./cayley load --config=cayley.cfg.overview --triples=30kmoviedata.nt.gz --alsologtostderr
```
And watch the log output go by.