Ophidia Analytics Framework Installation

This page presents the procedure to install, setup and test the Ophidia Analytics Framework from sources and binary packages.

Note

Before proceeding with the following steps, check that you have the required pre-requisites installed. In particular system developmente libraries, as well as MySQL server and MySQL devel libraries are required. Additionally, make sure the Ophidia I/O Server source code or binary package is already installed on the system where the Analytics Framework is going to be setup.

Preliminary dependencies

NetCDF C Library

To fully take advantage of the Analytics Framework features, netCDF library with parallel I/O support is required. Package versions listed in this section are recommanded, but more recent version of surce codes should be adequate.

CentOS7

You can install the parallel-enabled packages directly from yum:

sudo yum install hdf5-devel hdf5-mpich-devel
sudo yum install netcdf-devel netcdf-mpich-devel

Ubuntu 18

First install HDF5 libraries from apt:

sudo apt-get install libhdf5-mpich-dev libhdf5-dev

then download netcdf-4.4.0 from http://www.unidata.ucar.edu/downloads/netcdf/index.jsp and install it in the path /usr/local/ophidia/extra using the following configuration

tar -xzf netcdf-4.4.0.tar.gz
cd netcdf-4.4.0
CC=/usr/bin/mpicc CPPFLAGS="-I/usr/include/hdf5/mpich/" LDFLAGS="-L/usr/lib/x86_64-linux-gnu/hdf5/mpich/" LIBS=-ldl ./configure --prefix=/usr/local/ophidia/extra --enable-parallel-tests
make
make install

Install the Analytics Framework

Installation from sources

Installation from source can be used on most Linux distros (i.e. CentOS6, CentOS7, Ubuntu 14, Ubuntu 18).

As root run:

mkdir /var/www/html/ophidia
chown ophidia:ophidia /var/www/html/ophidia

As ophidia user create a folder to download and build Ophidia source code.

mkdir /usr/local/ophidia/src

Download Ophidia Analytics Framework release from https://github.com/OphidiaBigData/ophidia-analytics-framework/releases. Alternatively you can get the latest development version from the git repository:

git clone https://github.com/OphidiaBigData/ophidia-analytics-framework

Install the required dependencies:

  • jansson and related devel libraries
  • libXML2 devel libraries
  • openssl devel libraries
  • mpi devel libraries
  • gsl and related devel libraries
  • curl and related devel libraries

For example on CentOS

sudo yum install jansson\* libxml2\* openssl-devel mpich\* gsl gsl-devel libcurl libcurl-devel

on Ubuntu

sudo apt-get install libjansson-dev libxml2 libxml2-dev mpich libmpich-dev gsl-bin libgsl23 libgsl-dev libssl-dev libssl1.1 libcurl4 libcurl4-openssl-dev curl

Build and install Ophidia Analytics Framework

On CentOS7

cd /usr/local/ophidia/src/ophidia-analytics-framework
./bootstrap
./configure --prefix=/usr/local/ophidia/oph-cluster/oph-analytics-framework --enable-parallel-netcdf --with-netcdf-path=/usr/lib64/mpich --with-web-server-path=/var/www/html/ophidia --with-web-server-url=http://127.0.0.1/ophidia --with-ophidiaio-server-path=/usr/local/ophidia/oph-cluster/oph-io-server
make
make install

While on Ubuntu 18

cd /usr/local/ophidia/src/ophidia-analytics-framework
./bootstrap
./configure --prefix=/usr/local/ophidia/oph-cluster/oph-analytics-framework --enable-parallel-netcdf --with-netcdf-path=/usr/local/ophidia/extra --with-web-server-path=/var/www/html/ophidia --with-web-server-url=http://127.0.0.1/ophidia --with-ophidiaio-server-path=/usr/local/ophidia/oph-cluster/oph-io-server
make
make install

Then, if not already available, create the following folder

mkdir -p /usr/local/ophidia/oph-cluster/oph-analytics-framework/log

Note

If you want to enable support to import FITS data format install the following packages:

on CentOS

sudo yum install cfitsio

on Ubuntu

sudo apt-get install libcfitsio-dev

and add the following configuration parameter to command configure:

--enable-cfitsio

Note

In case of GSI support, install the prerequisites and append the following configuration parameters to arguments of command configure:

--with-interface-type=gsi --with-globus-include=/usr/include/globus --with-globus-libs=/usr/lib64 --enable-voms --with-voms-include=/usr/include/voms --with-voms-libs=/usr/lib64

Additionally, for GSI support, set the parameter SOAP_USERNAME in

/usr/local/ophidia/oph-cluster/oph-analytics-framework/etc/oph_soap_configuration

by substituting the default value (framework) with the Distinguished Name (DN) of the host, for example

/C=XX/O=XX/OU=Host/L=XX/CN=YY

where YY is the hostname.

Installation from RPM

To install the Ophidia Analytics Framework package on CentOS7 download the ophidia-analytics-framework rpm from https://download.ophidia.cmcc.it/rpm/1.5/ and run

sudo yum install ophidia-analytics-framework-1.5*.x86_64.rpm

Change owner of the installation folders

sudo chown -R ophidia:ophidia /usr/local/ophidia
sudo chown -R ophidia:ophidia /var/www/html/ophidia

Installation from DEB

To install the Ophidia Analytics Framework package on Ubuntu 18 download the ophidia-analytics-framework deb from https://download.ophidia.cmcc.it/deb/1.5/ and run

sudo dpkg -i ophidia-analytics-framework_1.5.*_amd64.deb

Change owner of the installation folders

sudo chown -R ophidia:ophidia /usr/local/ophidia
sudo chown -R ophidia:ophidia /var/www/html/ophidia

Finalize the setup

In case of single node instance the default configuration file oph_configuration under the etc folder can be used, however you may want to change the username and password value accordingly to your mysql configuration. See the Ophidia Analytics Framework configuration page for more details.

/usr/local/ophidia/oph-cluster/oph-analytics-framework/etc/oph_configuration