Go to file
Primoz 247d758cb7 Merge branch 'imputation_and_cleaning' of https://repo.ijs.si/junoslukan/rapids into imputation_and_cleaning 2022-09-21 07:18:01 +00:00
.github Update docs with contributing guide 2021-05-10 15:48:14 -04:00
data/external Changes in cleaning script: 2022-09-01 10:33:36 +00:00
docs Update change-log for v1.8.0 2022-02-10 15:05:55 -05:00
example_profile Make place for STRAW models. 2022-02-04 17:25:24 +01:00
models First commit 2019-10-22 13:11:01 -04:00
notebooks First commit 2019-10-22 13:11:01 -04:00
problems Keep track of warning messages. 2021-12-15 16:19:29 +01:00
references First commit 2019-10-22 13:11:01 -04:00
renv Small misc changes 2022-06-02 06:41:53 +00:00
reports Add restore_sql_file rule; notsummarised module; diff platforms for heatmap_days_by_sensors 2020-08-03 13:09:16 -04:00
rules Small imputation and cleaning corrections. 2022-09-20 08:03:48 +00:00
src Merge branch 'imputation_and_cleaning' of https://repo.ijs.si/junoslukan/rapids into imputation_and_cleaning 2022-09-21 07:18:01 +00:00
tests Small changes in cleaning scrtipt and missing vals testing. 2022-09-20 12:57:55 +00:00
tools Data cleaning (#166) 2021-11-19 10:34:36 -05:00
.Rprofile Add Travis CI 2020-05-18 19:24:34 -04:00
.gitattributes Force Unix style end of line. 2021-11-17 19:12:40 +01:00
.gitignore Squashed commit of the following: 2022-07-20 13:51:22 +00:00
Dockerfile Add libglpk40 dependency 2021-01-05 19:24:49 -05:00
LICENSE Update LICENSE 2020-03-10 16:52:23 -04:00
README.md Squashed commit of the following: 2022-07-22 15:31:30 +00:00
Snakefile Small imputation and cleaning corrections. 2022-09-20 08:03:48 +00:00
__init__.py Add folder structure for CF testing and EDA test. 2022-03-21 10:40:18 +00:00
automl_test.py Writing testing scripts to determine the point of manual imputation. 2022-09-14 14:13:03 +00:00
code_of_conduct.md Add code of conduct 2020-11-30 13:51:05 -05:00
config.yaml Small imputation and cleaning corrections. 2022-09-20 08:03:48 +00:00
environment.yml Changes in AutoML params and environment.yml 2022-09-13 13:54:06 +00:00
mkdocs.yml Add data stream for AWARE Micro server (#173) 2022-01-27 10:47:50 -05:00
rapids remove .py ext from rapids.py 2020-10-28 16:59:19 -04:00
renv.lock Updated R and Python package files. Updated README. 2022-07-07 15:30:07 +00:00

README.md

GitHub release (latest SemVer) Snakemake Documentation Status tests Contributor Covenant

RAPIDS

Reproducible Analysis Pipeline for Data Streams

For more information refer to our documentation

By MoSHI, University of Pittsburgh

Installation

For RAPIDS installation refer to to the documentation

For the installation of the Docker version

  1. Follow the instructions to setup RAPIDS via Docker (from scratch).

  2. Delete current contents in /rapids/ folder when in a container session.

    cd ..
    rm -rf rapids/{*,.*}
    cd rapids
    
  3. Clone RAPIDS workspace from Git and checkout a specific branch.

    git clone "https://repo.ijs.si/junoslukan/rapids.git" .
    git checkout <branch_name>
    
  4. Install missing “libpq-dev” dependency with bash.

    apt-get update -y
    apt-get install -y libpq-dev
    
  5. Restore R venv. Type R to go to the interactive R session and then:

    renv::restore()
    
  6. Install cr-features module From: https://repo.ijs.si/matjazbostic/calculatingfeatures.git -> branch modifications_for_rapids. Then follow the "cr-features module" section below.

  7. Install all required packages from environment.yml, prune also deletes conda packages not present in environment file.

    conda env update --file environment.yml prune
    
  8. If you wish to update your R or Python venvs.

    R in interactive session:
    renv::snapshot()
    Python: 
    conda env export --no-builds | sed 's/^.*libgfortran.*$/  - libgfortran/' | sed 's/^.*mkl=.*$/  - mkl/' >  environment.yml
    

cr-features module

This RAPIDS extension uses cr-features library accessible here.

To use cr-features library:

  • Follow the installation instructions in the README.md.

  • Copy built calculatingfeatures folder into the RAPIDS workspace.

  • Install the cr-features package by:

    pip install path/to/the/calculatingfeatures/folder
    e.g. pip install ./calculatingfeatures if the folder is copied to main parent directory
    cr-features package has to be built and installed everytime to get the newest version. 
    Or an the newest version of the docker image must be used.