... | ... | @@ -11,7 +11,7 @@ PEP can only store a single file in any given cell. If multiple files are to be |
|
|
|
|
|
Additionally, PEP does not (by default) perform any processing on the data it stores. The consequence is that downloaders will receive the exact same data that the uploader stored. Uploaders should therefore ensure that their data is stripped of information unsuitable for dissemination. This includes any fixed identifiers that the data may contain, since those could be used to blend the downloads from different access groups.
|
|
|
|
|
|
PEP eases some of these limitations with its built-in support for some [data formats](#data-format-processing).
|
|
|
PEP eases some of these limitations with its built-in support for some data formats. See the [section on that topic](#data-format-processing) for details.
|
|
|
|
|
|
# Uploading data
|
|
|
|
... | ... | @@ -37,7 +37,7 @@ The `pepcli` utility exits with code `0` (zero) if the `store` command succeeds, |
|
|
|
|
|
Note that the PEP system can only accommodate a single file in any given cell. If multiple files should be stored together (e.g. because the files would be useless individually, or because the data format requires it), the files must be packaged into a single file (e.g. a `tar` archive) before being `pepcli store`d. Downloaders will then receive the packaged file, which they should process accordingly.
|
|
|
|
|
|
PEP provides built-in processing facilities for some data formats. See the section on that topic @@@link@@@ for details.
|
|
|
PEP provides built-in processing facilities for some data formats. Special considerations may apply when uploading data to affected columns. See the [section on that topic](#data-format-processing) for details.
|
|
|
|
|
|
# Downloading data
|
|
|
|
... | ... | @@ -84,6 +84,8 @@ To prevent data loss, the `pepcli pull` command will be aborted |
|
|
|
|
|
Use the `--force` switch to have the command (discard/overwrite local data and) proceed anyway.
|
|
|
|
|
|
PEP provides built-in processing facilities for some data formats. Special considerations may apply when downloading data from affected columns. See the [section on that topic](#data-format-processing) for details.
|
|
|
|
|
|
## Manually `list`ing and `get`ting data
|
|
|
|
|
|
Like its `pull` command, the `pepcli` utility's `list` and `get` commands allow data to be downloaded from PEP. But although they provide more fine-grained control over the download process, they do not provide PEP's built-in support for [data format processing](#data-format-processing), making them unusable for certain types of data. **Use of these commands is therefore strongly discouraged.** They are retained only for backward compatibility purposes, and may be removed from future versions of PEP.
|
... | ... | |