Erwan Motte / GLORI Documentation

Download as
Browse Code »

Commit dc66561ed6edfcdaca5d1fee88c314fcb241a0a3

Authored by Erwan Motte
1 parent 47b25019
Exists in master

Updated install and filtering documentation

Showing 4 changed files with 130 additions and 10 deletions   Show diff stats
.idea/GLORI doc.iml 0 → 100644
  Diff comments   View file @dc66561
... ... @@ -0,0 +1,12 @@
  1 +<?xml version="1.0" encoding="UTF-8"?>
  2 +<module type="PYTHON_MODULE" version="4">
  3 + <component name="NewModuleRootManager">
  4 + <content url="file://$MODULE_DIR$" />
  5 + <orderEntry type="jdk" jdkName="Python 2.7.11 (C:\Users\motte\Anaconda2\python.exe)" jdkType="Python SDK" />
  6 + <orderEntry type="sourceFolder" forTests="false" />
  7 + </component>
  8 + <component name="TestRunnerService">
  9 + <option name="projectConfiguration" value="Nosetests" />
  10 + <option name="PROJECT_TEST_RUNNER" value="Nosetests" />
  11 + </component>
  12 +</module>
0 13 \ No newline at end of file
... ...
source/ANA/ANA_filtering.rst 0 → 100644
  Diff comments   View file @dc66561
... ... @@ -0,0 +1,46 @@
  1 +****************
  2 +Data Filtering
  3 +****************
  4 +
  5 +
  6 +Introduction
  7 +============
  8 +
  9 +
  10 +
  11 +Zenith antenna correlation amplitude
  12 +====================================
  13 +
  14 +It has been seen from the analysis of all the measurements, that tracking
  15 +and acquisition were performed sometimes with wrong parameters, in this
  16 +case, the correlation amplitude drops below 0.025.
  17 +
  18 +Total number of records 745320
  19 +
  20 +- < 0.025 a.u. : 6347 records (0.85%)
  21 +- > 0.025 a.u. : 738979 records (99.15%)
  22 +
  23 +.. image:: /img/hist_amp_ZR.png
  24 +
  25 +
  26 +Plane tilt (zenith elevation)
  27 +=============================
  28 +
  29 +The analysis of the histogram of plane tilts shows that most of the
  30 +measurements (plane considered leveled) belong in a zone where the computed
  31 +zenith angle is greater than 85 degrees
  32 +
  33 +Total number of records 745320
  34 +
  35 +- < 85 deg : 197356 records (26.48%)
  36 +- > 85 deg : 547964 records (73.52%)
  37 +
  38 +.. image:: /img/hist_tilt.png
  39 +
  40 +
  41 +
  42 +
  43 +
  44 +
  45 +
  46 +
... ...
source/ANA/ANA_index.rst
  Diff comments   View file @dc66561
... ... @@ -6,3 +6,4 @@ Data Analysis
6 6 :maxdepth: 2
7 7  
8 8 ANA_colocate
  9 + ANA_filtering
... ...
source/PRO/PRO_install.rst
  Diff comments   View file @dc66561
... ... @@ -46,11 +46,9 @@ Fedora Virtual machine installation
46 46 - create a shared folder in virtualbox, call it F_DRIVE, pointing to the
47 47 GLORI data folder
48 48  
49   - - on the Fedora machine add linux user to the virtualbox group
  49 + - on the Fedora machine add linux user to the virtualbox group ::
50 50  
51   - .. code-block:: none
52   -
53   - sudo usermod -aG vboxsf <user>
  51 + sudo usermod -aG vboxsf <user>
54 52  
55 53  
56 54 .. _virtualbox : https://www.virtualbox.org/
... ... @@ -62,12 +60,68 @@ Fedora configuration and software installation
62 60 All the following steps have to be done from Fedora or the Linux
63 61 distribution that will host the GLORI processing chain.
64 62  
65   -- Download and install `Anaconda python 2`_
  63 +- Install development tools with the following commands ::
66 64  
67   -- Download and install `PyCharm Community Edition`_
  65 + $ sudo dnf groupinstall 'Development Tools'
  66 + $ sudo dnf groupinstall 'C Development Tools and Libraries'
  67 +
  68 +
  69 +Python Module installation with pip
  70 +-----------------------------------
  71 +
  72 +Linux packages install
  73 +......................
  74 +
  75 +- gcc-gfortran
  76 +- blas-devel
  77 +- lapack-devel
  78 +- atlas-devel
  79 +- redhat-rpm-config
  80 +- python-devel
  81 +- geos-devel
  82 +- gdal-devel
  83 +- hdf5-devel
  84 +- netcdf-devel
  85 +
  86 +All these packages can be installed at once with the following commands::
  87 +
  88 + sudo dnf install gcc-gfortran blas-devel lapack-devel atlas-devel
  89 + sudo dnf install redhat-rpm-config python-devel geos-devel gdal-devel
  90 + sudo dnf install hdf5-devel netcdf-devel freetype-devel pygtk2-devel
  91 + sudo dnf install pyqt4-devel
  92 +
  93 +
  94 +Python module installation
  95 +..........................
68 96  
  97 +- h5py, netCDF4
  98 +- pandas
  99 +- geopandas
  100 +- fiona, shapely, pyproj, transforms3d
  101 +
  102 +Python module installation with anaconda
  103 +----------------------------------------
  104 +- Download and install `Anaconda python 2`_
69 105  
70 106 .. _`Anaconda python 2` : https://www.continuum.io/downloads#_unix
  107 +
  108 +
  109 +- Update using ::
  110 +
  111 + $ conda update conda
  112 + $ conda update anaconda
  113 +
  114 +- Install missing packages with ::
  115 +
  116 + $ conda install fiona pyproj shapely netcdf4
  117 + $ pip install geopandas
  118 +
  119 +
  120 +Install PyCharm IDE
  121 +-------------------
  122 +
  123 +- Download and install `PyCharm Community Edition`_
  124 +
71 125 .. _`PyCharm Community Edition` : https://www.jetbrains.com/pycharm/download
72 126  
73 127 Benchmark
... ... @@ -88,22 +142,29 @@ default we use all the cores and half of the available memory.
88 142 :header-rows: 1
89 143  
90 144 * - System
91   - - PM HDD
  145 + - Postmark
92 146 - RAM int
93 147 - RAM float
94 148 - C-Ray
95   - - Apache
  149 + - Numpy
96 150  
97 151 * - PRISM Fedora 23 VB
98 152 - 5 103
99 153 - 13 240
100 154 - 12 828
101 155 - 27
102   - - 11 170
  156 + - 6 613 451
103 157  
104 158 * - HP Fedora 24 VB 1 core
105 159 - 3 756
106 160 - 5 347
107 161 - 5 920
108 162 - 137
109   - - N/A
110 163 \ No newline at end of file
  164 + - N/A
  165 +
  166 + * - HP Fedora 24 VB 2 cores
  167 + - 3 750
  168 + - 6 103
  169 + - 6 263
  170 + - 67
  171 + - 8 592 955
111 172 \ No newline at end of file
... ...