Pull request #2: Add conda environment and installation
Merge in EAI/platform-demo-scripts from mambaforge-installation-method to switching_to_pytorch_lightning_and_pick_benchmark * commit '4b169cab5b9f8b277a44d905b52fdfb1f3d76550': Add installation method for OSX Add conda environment and installation
This commit is contained in:
commit
78ac51478c
56
README.md
56
README.md
@ -15,17 +15,55 @@ This repo contains notebooks and scripts demonstrating how to:
|
|||||||
This code is based on the [pick-benchmark](https://github.com/seisbench/pick-benchmark), the repository accompanying the paper:
|
This code is based on the [pick-benchmark](https://github.com/seisbench/pick-benchmark), the repository accompanying the paper:
|
||||||
[Which picker fits my data? A quantitative evaluation of deep learning based seismic pickers](https://doi.org/10.1029/2021JB023499)
|
[Which picker fits my data? A quantitative evaluation of deep learning based seismic pickers](https://doi.org/10.1029/2021JB023499)
|
||||||
|
|
||||||
### Before running
|
### Installation method 1
|
||||||
|
|
||||||
|
Please download and install [Mambaforge](https://github.com/conda-forge/miniforge#mambaforge) following the [official guide](https://github.com/conda-forge/miniforge#install).
|
||||||
|
|
||||||
|
After successful installation and within the Mambaforge environment please clone this repository:
|
||||||
|
|
||||||
|
```
|
||||||
|
git clone ssh://git@git.plgrid.pl:7999/eai/platform-demo-scripts.git
|
||||||
|
```
|
||||||
|
and please run for Linux or Windows platforms:
|
||||||
|
|
||||||
|
```
|
||||||
|
cd platform-demo-scripts
|
||||||
|
mambaforge env create -f epos-ai-train.yml
|
||||||
|
```
|
||||||
|
or for OSX:
|
||||||
|
```
|
||||||
|
cd platform-demo-scripts
|
||||||
|
mambaforge env create -f epos-ai-train-osx.yml
|
||||||
|
```
|
||||||
|
|
||||||
|
This will create a conda environment named `platform-demo-scripts` with all required packages installed.
|
||||||
|
|
||||||
|
To run the notebooks and scripts from this repository it is necessary to activate the `platform-demo-scripts` environment by running:
|
||||||
|
|
||||||
|
```
|
||||||
|
conda activate platform-demo-scripts
|
||||||
|
```
|
||||||
|
|
||||||
|
### Installation method 2
|
||||||
|
|
||||||
Please [install Poetry](https://python-poetry.org/docs/#installation), a tool for dependency management and packaging in Python.
|
Please [install Poetry](https://python-poetry.org/docs/#installation), a tool for dependency management and packaging in Python.
|
||||||
Then we will use only Poetry for creating Python environment and installing dependencies.
|
Then we will use only Poetry for creating Python environment and installing dependencies.
|
||||||
|
|
||||||
|
Install all dependencies with poetry, run:
|
||||||
|
|
||||||
|
```
|
||||||
|
poetry install
|
||||||
|
```
|
||||||
|
|
||||||
|
To run the notebooks and scripts from this repository it is necessary to activate the poetry environment by running:
|
||||||
|
|
||||||
|
```
|
||||||
|
poetry shell
|
||||||
|
```
|
||||||
|
|
||||||
### Usage
|
### Usage
|
||||||
|
|
||||||
1. Install all dependencies with poetry, run:
|
1. Prepare .env file with content:
|
||||||
|
|
||||||
`poetry install`
|
|
||||||
2. Prepare .env file with content:
|
|
||||||
```
|
```
|
||||||
WANDB_HOST="https://epos-ai.grid.cyfronet.pl/"
|
WANDB_HOST="https://epos-ai.grid.cyfronet.pl/"
|
||||||
WANDB_API_KEY="your key"
|
WANDB_API_KEY="your key"
|
||||||
@ -33,15 +71,11 @@ Then we will use only Poetry for creating Python environment and installing depe
|
|||||||
WANDB_PROJECT="training_seisbench_models_on_igf_data"
|
WANDB_PROJECT="training_seisbench_models_on_igf_data"
|
||||||
BENCHMARK_DEFAULT_WORKER=2
|
BENCHMARK_DEFAULT_WORKER=2
|
||||||
|
|
||||||
3. Transform data into seisbench format. (unofficial)
|
2. Transform data into seisbench format. (unofficial)
|
||||||
* Download original data from the [drive](https://drive.google.com/drive/folders/1InVI9DLaD7gdzraM2jMzeIrtiBSu-UIK?usp=drive_link)
|
* Download original data from the [drive](https://drive.google.com/drive/folders/1InVI9DLaD7gdzraM2jMzeIrtiBSu-UIK?usp=drive_link)
|
||||||
* Run the notebook: `utils/Transforming mseeds to SeisBench dataset.ipynb`
|
* Run the notebook: `utils/Transforming mseeds to SeisBench dataset.ipynb`
|
||||||
|
|
||||||
4. Initialize poetry environment:
|
3. Run the pipeline script:
|
||||||
|
|
||||||
`poetry shell`
|
|
||||||
|
|
||||||
5. Run the pipeline script:
|
|
||||||
|
|
||||||
`python pipeline.py`
|
`python pipeline.py`
|
||||||
|
|
||||||
|
21
epos-ai-train-osx.yml
Normal file
21
epos-ai-train-osx.yml
Normal file
@ -0,0 +1,21 @@
|
|||||||
|
name: epos-ai-train
|
||||||
|
channels:
|
||||||
|
- pytorch
|
||||||
|
- nvidia
|
||||||
|
dependencies:
|
||||||
|
- python=3.10
|
||||||
|
- pytorch=2.0.1
|
||||||
|
- PyYAML=6.0
|
||||||
|
- python-dotenv=1.0.0
|
||||||
|
- pandas=2.0.3
|
||||||
|
- obspy=1.4.0
|
||||||
|
- wandb=0.15.4
|
||||||
|
- torchmetrics=0.11.4
|
||||||
|
- pytorch-lightning
|
||||||
|
- scikit-learn
|
||||||
|
- openpyxl
|
||||||
|
- jupyterlab
|
||||||
|
- notebook
|
||||||
|
- pip
|
||||||
|
- pip:
|
||||||
|
- seisbench==0.4.1
|
22
epos-ai-train.yml
Normal file
22
epos-ai-train.yml
Normal file
@ -0,0 +1,22 @@
|
|||||||
|
name: epos-ai-train
|
||||||
|
channels:
|
||||||
|
- pytorch
|
||||||
|
- nvidia
|
||||||
|
dependencies:
|
||||||
|
- python=3.10
|
||||||
|
- pytorch=2.0.1
|
||||||
|
- pytorch-cuda
|
||||||
|
- PyYAML=6.0
|
||||||
|
- python-dotenv=1.0.0
|
||||||
|
- pandas=2.0.3
|
||||||
|
- obspy=1.4.0
|
||||||
|
- wandb=0.15.4
|
||||||
|
- torchmetrics=0.11.4
|
||||||
|
- pytorch-lightning
|
||||||
|
- scikit-learn
|
||||||
|
- openpyxl
|
||||||
|
- jupyterlab
|
||||||
|
- notebook
|
||||||
|
- pip
|
||||||
|
- pip:
|
||||||
|
- seisbench==0.4.1
|
Loading…
Reference in New Issue
Block a user