This page presents the procedure to install, setup and test the Ophidia Analytics Framework from sources and binary packages.
Note
Before proceeding with the following steps, check that you have the required pre-requisites installed. In particular system developmente libraries, as well as MySQL server and MySQL devel libraries are required. Additionally, make sure the Ophidia I/O Server source code or binary package is already installed on the system where the Analytics Framework is going to be setup.
To fully take advantage of the Analytics Framework features, netCDF library with parallel I/O support is required. Package versions listed in this section are recommanded, but more recent version of surce codes should be adequate.
CentOS7
You can install the parallel-enabled packages directly from yum:
sudo yum install hdf5-devel hdf5-mpich-devel
sudo yum install netcdf-devel netcdf-mpich-devel
Ubuntu 18
First install HDF5 libraries from apt:
sudo apt-get install libhdf5-mpich-dev libhdf5-dev
then download netcdf-4.4.0 from http://www.unidata.ucar.edu/downloads/netcdf/index.jsp and install it in the path /usr/local/ophidia/extra using the following configuration
tar -xzf netcdf-4.4.0.tar.gz
cd netcdf-4.4.0
CC=/usr/bin/mpicc CPPFLAGS="-I/usr/include/hdf5/mpich/" LDFLAGS="-L/usr/lib/x86_64-linux-gnu/hdf5/mpich/" LIBS=-ldl ./configure --prefix=/usr/local/ophidia/extra --enable-parallel-tests
make
make install
Installation from source can be used on most Linux distros (i.e. CentOS6, CentOS7, Ubuntu 14, Ubuntu 18).
As root run:
mkdir /var/www/html/ophidia
chown ophidia:ophidia /var/www/html/ophidia
As ophidia user create a folder to download and build Ophidia source code.
mkdir /usr/local/ophidia/src
Download Ophidia Analytics Framework release from https://github.com/OphidiaBigData/ophidia-analytics-framework/releases. Alternatively you can get the latest development version from the git repository:
git clone https://github.com/OphidiaBigData/ophidia-analytics-framework
Install the required dependencies:
For example on CentOS
sudo yum install jansson\* libxml2\* openssl-devel mpich\* gsl gsl-devel libcurl libcurl-devel
on Ubuntu
sudo apt-get install libjansson-dev libxml2 libxml2-dev mpich libmpich-dev gsl-bin libgsl23 libgsl-dev libssl-dev libssl1.1 libcurl4 libcurl4-openssl-dev curl
Build and install Ophidia Analytics Framework
On CentOS7
cd /usr/local/ophidia/src/ophidia-analytics-framework
./bootstrap
./configure --prefix=/usr/local/ophidia/oph-cluster/oph-analytics-framework --enable-parallel-netcdf --with-netcdf-path=/usr/lib64/mpich --with-web-server-path=/var/www/html/ophidia --with-web-server-url=http://127.0.0.1/ophidia --with-ophidiaio-server-path=/usr/local/ophidia/oph-cluster/oph-io-server
make
make install
While on Ubuntu 18
cd /usr/local/ophidia/src/ophidia-analytics-framework
./bootstrap
./configure --prefix=/usr/local/ophidia/oph-cluster/oph-analytics-framework --enable-parallel-netcdf --with-netcdf-path=/usr/local/ophidia/extra --with-web-server-path=/var/www/html/ophidia --with-web-server-url=http://127.0.0.1/ophidia --with-ophidiaio-server-path=/usr/local/ophidia/oph-cluster/oph-io-server
make
make install
Then, if not already available, create the following folder
mkdir -p /usr/local/ophidia/oph-cluster/oph-analytics-framework/log
Note
If you want to enable support to import FITS data format install the following packages:
on CentOS
sudo yum install cfitsio
on Ubuntu
sudo apt-get install libcfitsio-dev
and add the following configuration parameter to command configure:
--enable-cfitsio
Note
In case of GSI support, install the prerequisites and append the following configuration parameters to arguments of command configure:
--with-interface-type=gsi --with-globus-include=/usr/include/globus --with-globus-libs=/usr/lib64 --enable-voms --with-voms-include=/usr/include/voms --with-voms-libs=/usr/lib64
Additionally, for GSI support, set the parameter SOAP_USERNAME in
/usr/local/ophidia/oph-cluster/oph-analytics-framework/etc/oph_soap_configuration
by substituting the default value (framework) with the Distinguished Name (DN) of the host, for example
/C=XX/O=XX/OU=Host/L=XX/CN=YY
where YY is the hostname.
To install the Ophidia Analytics Framework package on CentOS7 download the ophidia-analytics-framework rpm from https://download.ophidia.cmcc.it/rpm/1.5/ and run
sudo yum install ophidia-analytics-framework-1.5*.x86_64.rpm
Change owner of the installation folders
sudo chown -R ophidia:ophidia /usr/local/ophidia
sudo chown -R ophidia:ophidia /var/www/html/ophidia
To install the Ophidia Analytics Framework package on Ubuntu 18 download the ophidia-analytics-framework deb from https://download.ophidia.cmcc.it/deb/1.5/ and run
sudo dpkg -i ophidia-analytics-framework_1.5.*_amd64.deb
Change owner of the installation folders
sudo chown -R ophidia:ophidia /usr/local/ophidia
sudo chown -R ophidia:ophidia /var/www/html/ophidia
In case of single node instance the default configuration file oph_configuration under the etc folder can be used, however you may want to change the username and password value accordingly to your mysql configuration. See the Ophidia Analytics Framework configuration page for more details.
/usr/local/ophidia/oph-cluster/oph-analytics-framework/etc/oph_configuration