CDPP / HELIOPROPA

Commit a26a5bcb0477ad0d08f678453b31696948e39e07

Authored by hitier
1 parent f6260cb7
Exists in rhitier-dev

Upgrade README

Showing 2 changed files with 83 additions and 83 deletions   Show diff stats
Inline Side-by-side
README.md
  Diff comments   View file @a26a5bc
  1 +# Heliopropa Web
1 2  
2   -## http://heliopropa.irap.omp.eu
  3 +A web site writen in flask for the visualisation of solarwind propagation simulations.
3 4  
4   -# What
  5 +Builds and serves heliopropa's visualizations.
5 6  
6   -## Web Server
7   -
8   -Build and serve heliopropa's visualizations.
9 7 It's a `flask` webserver, serving `d3.js` plots.
10 8 It also gathers NetCDF data from AMDA, and serves it as CSV to the plotter.
11 9  
12   -
13   -### Rationale
14   -
15   -- Reading NetCDF from javascript is doable, but still *very* hacky.
16   -- The bridge can handle pagination and collecting multiple NetCDF into one CSV.
17   -
18   -
19   -# How
20   -
21   -## Source
22   -
23   -https://gitlab.irap.omp.eu/CDPP/SPACEWEATHERONLINE
24   -
25   -
26   -## Overview
  10 +## Files Overview
27 11  
28 12 - `config.yml` : the main configuration file.
29 13 - `web/run.py` : the front controller, holding most of the code.
... ... @@ -32,56 +16,14 @@ https://gitlab.irap.omp.eu/CDPP/SPACEWEATHERONLINE
32 16 - `web/static/js/swapp.ls` : most of the javascript client-side.
33 17  
34 18  
35   -## Install
36   -
37   -### Prerequisites
38   -gcc
39   -libncurses-dev
40   -python3
41   -python3-virtualenv
42   -libapache2-mod-wsgi-py3
43   -
44 19 ### Python venv
45 20  
46 21 ``` bash
47 22 python3 -m venv venv
48 23 source venv/bin/activate
49   -pip install matplotlib
50   -pip install numpy==1.8.*
51 24 pip install -r requirements.txt
52 25 ```
53 26  
54   -### CentOs 6 Shenanigans
55   -
56   -``` bash
57   -yum install https://centos6.iuscommunity.org/ius-release.rpm
58   -yum install python27*
59   -```
60   -
61   -But then `virtualenv` yields
62   -
63   -```
64   -File "/var/www/html/HELIOPROPA/web/run.py", line 24, in <module>
65   -[Fri Nov 30 14:30:38 2018] [error] [client 10.10.135.119] from netCDF4 import Dataset, date2num
66   -[Fri Nov 30 14:30:38 2018] [error] [client 10.10.135.119] File "/var/www/html/HELIOPROPA/venv/lib/python2.7/site-packages/netCDF4/__init__.py", line 3, in <module>
67   -[Fri Nov 30 14:30:38 2018] [error] [client 10.10.135.119] from ._netCDF4 import *
68   -[Fri Nov 30 14:30:38 2018] [error] [client 10.10.135.119] ImportError: /var/www/html/HELIOPROPA/venv/lib/python2.7/site-packages/netCDF4/_netCDF4.so: undefined symbol: PyUnicodeUCS2_FromStringAndSize
69   -```
70   -
71   -_Solution:_
72   -Configure Apache to use `web/run_ssa.wsgi` and use pip2.7 install system wide.
73   -
74   -
75   -### Install libcdf.
76   -
77   -``` bash
78   -wget https://spdf.gsfc.nasa.gov/pub/software/cdf/dist/cdf38_1/cdf38_1-dist-all.tar.gz
79   -tar -xzvf cdf38_1-dist-all.tar.gz
80   -cd cdf38_1-dist
81   -make all OS=linux ENV=gnu
82   -make INSTALLDIR=/usr/local/lib/libcdf install
83   -```
84   -
85 27 ## Develop
86 28  
87 29 ``` bash
... ... @@ -91,29 +33,12 @@ DEBUG=true python web/run.py
91 33  
92 34 Then, browse [localhost:5000](http://localhost:5000).
93 35  
94   -
95   -## Troubleshoot
96   -
97   -### Installing scipy
98   -
99   -Getting `MemoryErrors` ?
100   -Try with the `--no-cache-dir` option.
101   -
102   -`pip install scipy --no-cache-dir`
103   -
104   -### Fix permissions problems with the cache
105   -
106   -```
107   -sudo setfacl -R -m u:apache:rwx -m u:`whoami`:rwx cache
108   -sudo setfacl -dR -m u:apache:rwx -m u:`whoami`:rwx cache
109   -```
110   -
111   -# Gunicorn and Nginx deployment on OVH for development
  36 +## Gunicorn and Nginx deployment on OVH for development
112 37  
113 38 see [ Digital Ocean documentation ] (https://www.digitalocean.com/community/tutorials/how-to-serve-flask-applications-with-gunicorn-and-nginx-on-ubuntu-20-04-fr)
114 39  
115 40  
116   -## wep app service and Gunicorn
  41 +### wep app service and Gunicorn
117 42  
118 43 see ./resources/heliopropa.service
119 44  
... ... @@ -133,7 +58,7 @@ see ./resources/heliopropa.service
133 58 [Install]
134 59 WantedBy=multi-user.target
135 60  
136   -## Nginx
  61 +### Nginx
137 62  
138 63 see ./resources/heliopropa.nginx
139 64  
... ... @@ -150,7 +75,7 @@ see ./resources/heliopropa.nginx
150 75 }
151 76  
152 77  
153   -## Start and Allow at system reboot
  78 +### Start and Allow at system reboot
154 79  
155 80 sudo systemctl start nginx
156 81 sudo systemctl start heliopropa
... ...
SPACEWEATHERONLINE.md 0 → 100644
  Diff comments   View file @a26a5bc
... ... @@ -0,0 +1,75 @@
  1 +
  2 +## http://heliopropa.irap.omp.eu
  3 +
  4 +# What
  5 +
  6 +
  7 +### Rationale
  8 +
  9 +- Reading NetCDF from javascript is doable, but still *very* hacky.
  10 +- The bridge can handle pagination and collecting multiple NetCDF into one CSV.
  11 +
  12 +
  13 +# How
  14 +
  15 +## Source
  16 +
  17 +https://gitlab.irap.omp.eu/CDPP/SPACEWEATHERONLINE
  18 +
  19 +
  20 +## Install
  21 +
  22 +### Prerequisites
  23 +gcc
  24 +libncurses-dev
  25 +python3
  26 +python3-virtualenv
  27 +libapache2-mod-wsgi-py3
  28 +### CentOs 6 Shenanigans
  29 +
  30 +``` bash
  31 +yum install https://centos6.iuscommunity.org/ius-release.rpm
  32 +yum install python27*
  33 +```
  34 +
  35 +But then `virtualenv` yields
  36 +
  37 +```
  38 +File "/var/www/html/HELIOPROPA/web/run.py", line 24, in <module>
  39 +[Fri Nov 30 14:30:38 2018] [error] [client 10.10.135.119] from netCDF4 import Dataset, date2num
  40 +[Fri Nov 30 14:30:38 2018] [error] [client 10.10.135.119] File "/var/www/html/HELIOPROPA/venv/lib/python2.7/site-packages/netCDF4/__init__.py", line 3, in <module>
  41 +[Fri Nov 30 14:30:38 2018] [error] [client 10.10.135.119] from ._netCDF4 import *
  42 +[Fri Nov 30 14:30:38 2018] [error] [client 10.10.135.119] ImportError: /var/www/html/HELIOPROPA/venv/lib/python2.7/site-packages/netCDF4/_netCDF4.so: undefined symbol: PyUnicodeUCS2_FromStringAndSize
  43 +```
  44 +
  45 +_Solution:_
  46 +Configure Apache to use `web/run_ssa.wsgi` and use pip2.7 install system wide.
  47 +
  48 +
  49 +### Install libcdf.
  50 +
  51 +``` bash
  52 +wget https://spdf.gsfc.nasa.gov/pub/software/cdf/dist/cdf38_1/cdf38_1-dist-all.tar.gz
  53 +tar -xzvf cdf38_1-dist-all.tar.gz
  54 +cd cdf38_1-dist
  55 +make all OS=linux ENV=gnu
  56 +make INSTALLDIR=/usr/local/lib/libcdf install
  57 +```
  58 +
  59 +
  60 +## Troubleshoot
  61 +
  62 +### Installing scipy
  63 +
  64 +Getting `MemoryErrors` ?
  65 +Try with the `--no-cache-dir` option.
  66 +
  67 +`pip install scipy --no-cache-dir`
  68 +
  69 +### Fix permissions problems with the cache
  70 +
  71 +```
  72 +sudo setfacl -R -m u:apache:rwx -m u:`whoami`:rwx cache
  73 +sudo setfacl -dR -m u:apache:rwx -m u:`whoami`:rwx cache
  74 +```
  75 +
... ...