Data Integration and Virtualisation
With extensive experience in Oracle Data Integrator and the Cloudera Big Data Stack we've got all of your integration needs covered, whatever the size of your data.
With hands on experience with systems of all sizes and workloads, we'll look after your data and analytics estate and keep things running smoothly 24 hours a day.
Virtualization is used to abstract applications from the servers that run them. In today's world it's a must to be fast paced and able to react to changes in demand. We're able to help you deploy and configure Hardware or Container virtualisation platforms.
Watchtower is a docker container that will update the version of other running containers. You can cha
Read MoreHere is a Bash script for getting a tag value from within a running EC2 Instance. For more information
Read MoreParallel replication has been available in MariaDB since Version 10.0.5, however requires at least ver
Read MoreAWS CodeDeploy Agent is the agent that runs deploy jobs on EC2 instances. Before a CodeDeploy job will
Read MoreHere is the script for installing the AWS CodeDeploy agent on Ubuntu. See the full description here. F
Read MoreStorj V3 is now in BETA and recruiting Storage Node operators. Since V3 of Storj, Docker is used exclu
Read MoreHere is a quick snippet which solves an issue I ran into today. I’ve recently set up Apache Traf
Read MoreMySQL or MariaDB has several data types for handling text-based characters. There are several data typ
Read MoreCreate a new directory and save the above file inside it as docker-compose.yml. You’ll need to r
Read MoreApache Traffic Server is an enterprise-grade proxy and caching server initially developed by Yahoo, th
Read MoreDocker-compose is a utility used to create and manage multiple Docker containers together to form a se
Read MoreTesting Docker, thankfully is one of the easiest things you can do – something you’d expec
Read MoreThe below docker-compose yml file will create two Docker containers for running WordPress; a MySQL dat
Read MoreRclone is a command line utility used for reading and writing to almost any type of cloud or remote st
Read MoreThis is a gitignore file for a Go project to ensure temporary files and build files are not added to g
Read MoreFirst off let’s create a table to store the bank holiday values. You may need to adjust this sli
Read MoreThe above error can occur when calling a cursor results in no rows, or no more rows if called in a loo
Read MoreMySQL and MariaDB enable you to define your own error conditions and to report back to the SQL client
Read MoreThis is a simple systemd script for CockroachDB. It works for single node installations or multiple no
Read MoreThis is an example of a .gitignore file for an Eclipse project to ensure temporary files, build files
Read MoreThe default TCP port for PostgreSQL is usually 5432, however this can easily be changed in the postgr
Read MoreAn example gitignore file for Nodejs projects to ensure that local environment variables, build relate
Read MoreA gitignore file for most Netbeans projects to keep the build and local configuration files out of you
Read MoreA gitignore file to ignore standard OS (usually Windows) generated files. Often you’d use this i
Read MoreMySQL and MariaDB present a bunch of queryable objects that give you all sorts of insights into what&#
Read MoreCreate a MySQL or MariaDB view to show the size of each table in the database:
Read MoreCreate a MySQL or MariaDB view to show the aggregated size of each schema in the database:
Read MoreThe below is an excerpt from docker.com listing the –filter options available for docker image
Read MoreThe below is an excerpt from docker.com listing the –filter options available with docker ps.
Read MoreThis simple one-liner will take a regular expression (regex) and remove any Docker containers matching
Read MoreHere is a super simple little tip for clearing the mysql.slow_log in MySQL or MariaDB when running an
Read MoreUnlike recent versions of Maria DB, MySQL does not currently support the command EXECUTE IMMEDIATE. E
Read MoreBash, whilst great for simple things, can be tricky to use more advanced programming techniques that a
Read MoreI’ve recently hit an issue when trying to include a sequence.nextval in an Oracle database view.
Read MoreCREATE SEQUENCE seq_test MINVALUE 1 START WITH 1 INCREMENT BY 1 CACHE 20 / CREATE OR REPLACE FUNCTION
Read MoreUsing Oracle Database materialized views for query rewrite, when used in the right way, can really hel
Read MoreThe Proxmox Web GUI does not give us the ability to migrate a container from one storage device to ano
Read MoreProxmox backs up guests byte-for-byte in a compressed archive. Looking at LXC backups specifically, th
Read MoreAfter issuing the first build on a dynamically created Container I came across the following build err
Read MorePlease see Install Oracle Java In Debian/ Ubuntu using apt-get for more information. apt install -y
Read MoreRenaming a Linux server’s hostname is usually a trivial task, and that’s no Different to a
Read MoreRecently I needed to have some conditionally formated grand total rows in OBI. I remember years ago ha
Read MoreThe Proxmox Web API can perform any actions available in the front end Web. By implementing a REST API
Read MoreProxmox has 2 API access points that can be used to control your Proxmox server and virtual guests. On
Read MoreThe Proxmox Web API can perform any actions available in the front end Web. By implementing a REST API
Read MoreSomewhat off-topic today, but something that I’ve recorded here to showcase the current state an
Read MoreThe following iptables rules are are a starting point to add basic firewall security to a public facin
Read MoreLinux Container (LXC) management is now often dealt with by LXD, the Canonical lead project bui
Read MoreLinux Container (LXC) management is now often dealt with by LXD, the Canonical lead project built on t
Read MoreCurrently, version 2.0 of CouchDB doesn’t come with any form of startup script. I’m sure t
Read MoreHere are some basic IPTable rules to enable essential connectivity from the host. Outbound connectiv
Read MoreThis is a reminder for myself more than anything else, on how to get wget to download SSL internet con
Read MoreI’ve been getting the following error when using apt-get update with Debian Wheezy recently. E
Read MoreThis script is used to set up the test table for the following blog posts: Oracle Database INTERVAL Pa
Read MoreOracle Java is one of the biggest problems in life. That’s just a fact. Half of it is the fact t
Read MoreApache Cassandra™ is a massively scalable open source NoSQL database. Cassandra is built from day 1
Read MoreThe following process will install the DataStax distribution of Cassandra on any Debian based system,
Read MoreThe below script installs the DataStax distribution of Cassandra 3.2.x and the latest Oracle Java 8 o
Read MoreMongoDB is one of the leading noSQL breeds of database that’s been growing in popularity in rece
Read MoreThe below script installs MongoDB 3.2.x on Debian. Copy and paste the script into a file called insta
Read MoreLet me start by saying… this is a quick and dirty method and shouldn’t be used for precise
Read MoreOracle Java, due to Oracle’s license conditions, it quite a pain to install. The problem is that
Read MoreSpamAssassin does a great job at identifying SPAM emails and is probably one of the most popular in it
Read MoreAfter installing glusterfs-client on my Debian server I received the below error when trying to moun
Read MoreI received the below error today after I tried to add a ‘new’ brick to a GlusterFS volume
Read MoreYou may get the following error when trying to mount a GlusterFS volume locally. The error displayed g
Read MoreThe MySQL and MariaDB server both use a file called my.cnf for parameters that are used to configure
Read MoreIf you’ve lost or forgotten the root user password on a MySQL or MariaDB server you’ll wan
Read MoreOnce you’ve got a Ceph cluster up and running you’re going to want to mount it somewhere.
Read MoreI’ve written a few posts about Ceph, how it works and how it’s set up and it mostly revolv
Read MoreYou can pass a loop device through to an OpenVZ container with the vzctl command. You’ll need
Read MoreThe below file content should be added to your ceph.conf file to reduce the resource footprint for l
Read MoreJust like when creating a SWAP file, you can create a file on a disk and present it as a block device.
Read MoreThere are various things you need to consider when creating a virtual disk for a virtual machine, such
Read MoreThe qcow2 image format is the defacto image format for KVM/ QEMU virtual machines. The format provide
Read MoreAn LXC containers storage is simple to set and maintain and is usually done through either a Web based
Read MoreThe OBIEE Administration Tool provides a useful utility for exporting the data lineage held within the
Read MoreIf you’ve installed a desktop, such as Gnome, on Linux you may not need it all the time. Some of
Read MoreOracle’s VirtualBox can use a few different virtual disk types, however their own disk type is
Read MoreThis 5 line script will quickly create a 512MB SWAP file that will be automatically mounted on each ma
Read MoreIf you’re using Debian, Ubuntu, or any similar distribution which uses apt-get as it’s pa
Read MoreAs of Zentyal version 4.2 the bundled certificate authority (CA) module is creating signed certificate
Read Moreqcow2 is a virtual disk image format developed by the guys who created QEMU and is one of the most ver
Read MoreUtilities such as apt-get generally install kernel updates by adding the new kernel to the Linux boot
Read MoreZentyal, the “all-in-one” exchange server replacement and does quite a good job delivering
Read MoreFinding the IP address of your local machine couldn’t be easier – ipconfig on Windows or
Read MoreOBIEE isn’t designed for (near) real time reporting, and as such doesn’t have an out of th
Read MoreOracle have a very restrictive license that applies to most of their software downloads which prohibit
Read MoreIt’s never been easier to set up your own Git server to host your own git repositories for your
Read MoreA symbolic Link is a reference to a file which is stored in another location to make a file or folder
Read MoreThere are many alternatives to MySQL that tick some of the boxes you may require. There are plenty of
Read MoreI’ve been using RAM disks within Linux for quite some time now and I’ve blogged about it w
Read MoreAn RPD file saved by one version of the OBIEE Administration Tool cannot be opened by an older version
Read MoreA disk image, such as the popular qcow2 disk image can be read and used as a file system without havin
Read MoreThere are various ways to integrate OBIEE and Essbase when using SSO, each with their own security spe
Read MoreIn a previous blog post I detailed the steps involved in creating a new Docker container, making some
Read Moregetopts is a way of adding intuitive options to custom bash scripts in Linux. getopts is a command tha
Read MoreThe noVNC console in the Proxmox Web GUI transfers it’s data through a technology called Websock
Read MoreIf you’ve installed OBIEE as many times as I have you’ll be more than familiar with the RC
Read MoreIf you are using a cluster configuration, there are multiple methods you can use to deploy a skin. Bel
Read MoreWhen copying or making significant changes to the OBIEE 11G web catalog, users can experience difficul
Read Moreopatch is Oracle’s tool for patching software such as OBIEE and ODI and is used in conjunction w
Read MoreERPNext is an Enterprise Resource Planning suite similar to Odoo. It manages every aspect of your busi
Read MoreFrappe is a full stack web framework based on Python and Javascript which can be used to build and de
Read MoreEnabling web content compression is one of the simplest ways to save bandwidth and, for some users, s
Read MoreZimbra Email Server is an install anywhere, full featured email server solution. I know that sounds li
Read MoreInstalling Nginx on Debian or Ubuntu is as easy as a single apt-get command, however it does not ins
Read MoreThe Linux command last can tell you when your Linux system last rebooted, shutdown, who logged in an
Read MoreKeeping an eye on all of your containers disk space can be time consuming if done one by one. Luckily,
Read MoreI came across this error today when trying to manually backup the container to create an OpenVZ contai
Read MoreThe following script will install the MariaDB Galera Server binaries on multiple servers with a basic
Read MoreA task often required when new storage is added or removed, and containers grow over time is to move
Read MoreUSB Passthrough is the concept of passing a USB device that is plugged into the host server to a guest
Read MoreYou may see the below error in your Nginx web server log files, and the good news is it’s easy
Read MoreThis is a small, handy snippet to kill a Linux process based on matching a string from the ps command
Read MoreMariaDB is termed a drop in replacement for MySQL – that means that you can deploy MariaDB witho
Read MoreI spoke about master – slave replication in my previous blog post and how to set up one way repl
Read MoreThe MySQL server can replicate a database over TCP to another instance of MySQL to provide a near real
Read MoreThe Proxmox web GUI is served by Proxmox’s new event driven API server called PVE Proxy. The def
Read MoreDocker is probably one of the easiest environments to create a virtualised instance based on a number
Read MoreOne of the driving forces behind Docker is to create a consistent environment across all Docker enable
Read MoreDocker is an up and coming virtualisation technology utilising Linux Containers (LXC) to provide a pri
Read MoreOpen vSwitch is a virtual switch which enables you to create multiple virtual networks on a single phy
Read MoreThe ports required by Samba vary depending on if you use Samba as a domain controller or not. The mos
Read MoreThe Splunk Universal Forwarder is a small, light weight daemon which forwards data to your main Splunk
Read MoreThe latest Ubuntu long term support is now available, called Ubuntu 14.04. There isn’t currently
Read MoreSplunk is the heavyweight open source software which enables you to index, visualise and explore virtu
Read MoreThe Apache HTTP is able to redirect traffic to a specific URL with use of the Apache mod_rewrite. mod_
Read MoreThe Apache HTTP server can be used with LDAP or Microsoft’s Active Directory to authenticate use
Read MoreThere are many web front ends to the OpenVZ virtualisation server which offer varying functionality an
Read MoreOpenVZ servers are hypervisors which allow you to create numerous guest instances within a single hard
Read MoreOpenVZ containers, or CT for short, work on the premise of using a template as the starting point for
Read MoreIf you have forgotten the password for an OpenVZ container – relax! Help is at hand. Luckily Ope
Read MoreYou can easily remove a Windows service from the Windows registry using a simple command prompt comman
Read MoreCreating a template from an OpenVZ container is a very manual process. My biggest problem is that you
Read MoreI previously wrote in this blog post about how to fix an error with Gitlab. The error was presented wh
Read MoreI recently received the below error when running Blue Iris CCTV software on Windows Server 2008. The p
Read MoreCeph is an open source storage platform which is designed for modern storage needs. Ceph is scalable t
Read MoreCeph is an open source storage platform which is designed for modern storage needs. Ceph is scalable t
Read MoreThe latest BETA of Proxmox, and soon to be released 3.2 comes with the Ceph client automatically insta
Read MoreI recently received the below error when installing Ceph on Proxmox which related the the key for the
Read MoreFail2ban is an application that scans log files in real time and bans malicious IP addresses based on
Read MoreProxmox does not have native support for an OVA template which is surprising considering it’s th
Read MoreSecure key authentication is one of the more secure ways to grant users access to a Linux server. The
Read MoreThe thing I find most annoying with Windows is that it isn’t Linux. Let’s forget the argum
Read MoreGood news: installing Grails from source is easy-peasey on Windows! Before you get started, you’
Read MoreI have recently been using git to check in an applications database. The database has many tables, som
Read MoreMatt Martez has kindly created and shared a Python script for interacting with speedtest.net for testi
Read MoreDropbox is a cloud based file storage service which makes your files available from almost any interne
Read MoreGiven the amount of trouble you can have getting Linux and Windows to play nicely together, you may be
Read MoreFrom time to time you will need to shutdown and startup your Proxmox hardware node. There are many rea
Read MoreYou can spend hours tweaking the settings of a MySQL server instance to get the best possible performa
Read Moreapt-get is the tool used in Debian and Ubuntu to manage packages installed on the system. Each time an
Read Moredoskey on Windows is very similar to alias on Linux, it allows you to set a term which will call a com
Read MoreWith Git you are able to define file exceptions to exclude certain files and folders from git reposito
Read MoreThe easiest way to do a one off move of a MySQL database from one server to another is to use the mys
Read MoreCreating multiple SSL certificates for web servers and application can be a repetitive task. Generally
Read MoreThe windows command line can be very useful to quickly perform repetitive tasks. It is easy to write b
Read MoreGlusterFS can be used to synchronise a directory to a remote server on a local network for data redund
Read MoreThere is a handy command called showmount which displays all the active folder exports on an NFS serv
Read MoreBonnie++ is a disk and file system benchmarking tool for measuring I/O performance. With Bonnie++ you
Read MoreUsually a web server can be accessed by multiple paths, such as the DNS entry of the server (eg. as ww
Read MoreThe default PPTP client for Linux does not automatically start on boot, or restart on a failed or drop
Read MoreI was receiving this error when I was trying to start a PPTP client connection in a Linux cron. The er
Read MoreA Virtual Private Network, or VPN, allows the client computer to connect to a remote local network to
Read MoreThere are many reasons for creating a memory based file system in Linux, not least of which is to prov
Read MoreJava applications can use a proxy server for making HTTP/ HTTPS connections to the internet by adding
Read MoreThe Proxmox web GUI is accessible on port 8006 by default using SSL encryption. The web GUI is served
Read MoreClustering is a technique to group together multiple machines or devices providing common parameters,
Read MoreI started to receive an error in one of my Proxmox OpenVZ containers which indicated that the quota ha
Read MoreI have been using Gitlab for a while now to run a local Git server for storing code and documentation
Read MoreThe below script is a bash script which works with Proxmox and the OpenVZ commands to backup all known
Read Moremdadm can take quite a while when rebuilding arrays and the more disks there are, the longer it will t
Read MoreSubsonic is a web-based media player for playing audio and video files through a web browser. You can
Read Moremdadm is a software RAID technology for creating local volumes with RAID functionality such as RAID 5.
Read MoreMost versions and distributions of Linux today have a start up manager application to easily set which
Read MoreThe OpenNode Management Server is installed with a default password. To help ensure your OpenNode serv
Read MoreI mostly use Proxmox from the command line, or terminal, and I have created a few scripts to perform c
Read MoreI use Proxmox to host a development environment using OpenVZ containers. I take frequent backups of al
Read MoreIf installing GlusterFS on Debian using the launchpad repository then a log rotate entry will be autom
Read MoreYou’ll be glad to know that GlusterFS has built in log rotation! This means that you can use a s
Read MoreOpenNodes web management GUI (OMS) runs in it’s own OpenVZ container. To update the running OMS
Read MoreThe OpenNode Management service, or OMS, is used to administer OpenNode via a web based GUI. The OMS i
Read MoreInstalling OpenNode is much like installing any other modern Linux distribution. You start with a text
Read MoreThere are various options for adding additional storage to an OpenVZ container. You can add additional
Read MoreI have been using an Oracle Enterprise Linux (OEL) OpenVZ container in Proxmox for installing some Ora
Read MoreI have been having trouble with a Proxmox node which is only running OpenVZ containers however it is a
Read MoreI have been using GlusterFS to replicate storage between two physical servers for two reasons; load ba
Read MoreI have been using GlusterFS to provide file synchronisation over two networked servers. As soon as the
Read MoreProxmox 3.1 has implemented a new repository setup, as described in my recent blog post. Each time you
Read MoreBenchmarking disk or file system IO performance can be tricky at best. The problem is that modern file
Read MoreIperf is an Open source network bandwidth testing application, available on Linux, Windows and Unix. I
Read MoreI have recently been playing around with Git on Ubuntu and noticed that the version in the standard re
Read MoreProxmox 3.1 brings a new storage plugin; GlusterFS. Thanks to this storage technology we can use distr
Read MoreMost Linux based systems use a software repository which is either local (a CD-ROM) or remote (a web a
Read MoreYou can allocate storage to an OpenVZ container during creation, when the container is offline and eve
Read MoreSince ZFS was ported to the Linux kernel I have used it constantly on my storage server. With the abil
Read MoreZFS datasets support a host of features to help you manage your storage mounts as effectively as possi
Read MoreZFS datasets support a host of features to help you manage your storage mounts as effectively as possi
Read MoreZFS is a disk and logical volume manager combining raid like functionality with guaranteeing data inte
Read MoreIf you can, your storage servers should be in a secure zone in your network removing the need to firew
Read MoreWhen you create a new GlusterFS Volume it is publicly available for any server on the network to read.
Read MoreThis post will show you how to install GlusterFS in Ubuntu/ Debian however the steps will be similar w
Read MoreGlusterFS is an open source distributed file system which provides easy replication over multiple stor
Read MoreProxmox version 3.1 made a huge change to the way updates are managed. Prior to version 3.1, updates f
Read MoreIn a previous post, we saw how to create a virtual IP address, based on an existing network interface.
Read MoreSome web applications I work with are only available on a URL similar to http://hostname/application.
Read MoreIf you need a software firewall to shield containers on a Proxmox stack, you should always use a firew
Read MoreAlthough installations of Proxmox usually go smoothly, sometimes you may have problems detecting stora
Read MoreInstalling Proxmox is quick and easy – the installer GUI takes care of everything, such as insta
Read MoreI had a problem with a SMB share which was sharing storage from an NFS mount. Whilst you could argue t
Read MoreSparse disk image formats such as qcow2 only consume the physical disk space which they need. For exam
Read MoreIt’s easy to change your password in linux – don’t bother with the GUI’s which
Read MoreThis post will detail how to set ip a virtual IP address and assign an interface to handle the traffic
Read MoreSometimes you may want to restart windows without clicking the Start menu. In some cases, such as in a
Read MoreThe kind folks over at OpenVZ.org have created a rift of templates which we can use as a starting poin
Read MoreWhen backing up in Proxmox, especially on the lower end of the server market, the backup process can c
Read MoreESXi does not provide an option to backup a running virtual machine, without paying VMware a substanti
Read MoreSince the 2.6.18-028stable021 kernel, it has been possible to set the I/O priority of an OpenVZ conta
Read MoreOpenSearchServer is an open source website crawler and query engine to provide advanced search capabil
Read MoreProxmox can be installed on very little disk space. I tested Proxmox version 2.2 and installed it on a
Read MoreOpenVZ containers have a mechanism in place to prioritise CPU resource assignment. You can make
Read MoreBackground Apache can be used as a reverse proxy to relay HTTP/ HTTPS requests to other machines. This
Read MoreBackground Apache VirtualHosts are something of a must for running multiple sites with different web a
Read MoreWhat is Proxmox? Proxmox is a hypervisor which can host hardware virtualized virtual machines as well
Read MoreYou can access the Proxmox web GUI from a web browser using the https protocol, your Proxmox server I
Read MoreProxmox has a test repository (repo) which can be used to deliver the latest software and updates usin
Read MoreProxmox 2 makes setting up AD authentication simple if you have the AD server names. AD only provides
Read More