Link

Breakfast with Exasol

coffee-1569682_1280

Exasol are putting on an event in central London on the 7th October 2016 for you to get to know more about them.

Starting with breakfast at the Eight Members Club in Moorgate, they’ll be hosting great speakers from King (Andy Done) and Adidas, discussing how they make the most out of their data with Exasol. After the talks there is a networking session, for you to network with existing and prospective Exasol users.

Find out more about the event and register to attend for free here.

The talks were great at exaxp16, and I’d recommend giving it a go if you’re interested in Exasol.

HOW TO: Make sure EXAPlus aborts execution on Error

ErrorHandling

It surprised me to learn that by default, on executing multiple commands in EXAPlus, the execution does not stop on error.

I was happily executing batches of code and thinking that everything was fine, as it all executed so quickly, and the last message displaying in the log panel was successful, so therefore, everything worked out…right? WRONG!

My code had a bug in one of the middle scripts, but despite the execution encountering the error, the execution as a whole continued.

Luckily, this was highlighted to me at exaxp16, by one of the support team.

So, here’s how to set the flag, to abort execution on error in EXAPlus:

In EXAPlus, go to SQL > Error Handling > All Errors > Select Abort

Changes to the Exasol licensing model from Version 6

Before we get started, I do not work for Exasol and I’m not privy to any “insider” knowledge, so obviously this information might change going forward, and I’d seek a discussion with your Exasol account manager, if you’d like to know more.

At exaxp16, Dr Jens Graupmann, discussed the forthcoming changes to Exasol in Version 6. Along with this was the discussion about 2 new pricing models.

My understanding, is that from Version 6, there will be 2 pricing models; Standard and Advanced

Standard

Standard edition will contain enough features to perform Basic Reporting and BI. There will still be the super fast DWH and accelerated BI components. This would be perfect for real-time self serve BI.

Advanced

The Advanced edition will contain In-Database Analytics (R, Python, Java), meeting the needs of complex integration. It will also meet non-relational database demands by interfacing with Hadoop. Advanced will, of course, encompass the Standard edition.

What else is to come in Version 6, and beyond?

In my last post, I discussed just a few highlights of what’s to come in Version 6, that were discussed at exaxp16.

Here are a few more, aimed at making Exasol even faster, and easier to interface with:

  • Bucket File System 
  • XML RPC Improvements – automate almost all install and configuration with the XML RPC API
  • JSON based websocket API
  • HDFS – for backup/restore
  • More AWS S3 support
  • DISTRIBUTE BY is getting faster – meaning MERGE, ETL and Cluster resize should also become faster
  • Consistent hashing – for faster cluster enlargement
  • Backups and Restore – will be faster in EXAStorage
  • Improved MERGE and JOINs (nested loop and full outer)
  • Hybrid tables – faster single inserts and deletes (by means of a column orientated tail block changed to a row orientated tail block)

Not only are there lots of changes coming in Version 6, it looks like the backlog for 6.1 has some great features:

  • Snapshot Isolation
  • Data partitioning and segmentation
  • Virtualisation and Modularisation (DOCKER)
  • Geo-spatial Index
  • Data Vault optimisation
  • Virtual Schema Improvements (with an intelligent data cache)

Exasol Xperience 2016 – What’s to come in Version 6

exaxp16

The Exasol Xperience event was the first of it’s kind, bringing together more than 100 attendees, from 16 countries. It has provided invaluable networking opportunities and insights on Exasol users experience of Exasol and the challenges that they are solving daily with it. You can see some great pictures and tweets of the event here.

The first day of the Exasol Xperience was full of many highlights, but one in particular I have been waiting for, for months; the release details of Version 6.

Dr Jens Graupmann recapped Exasol’s history with us first, and here are some of the points I noted of interest before we dive into what Version 6 will contain!

  • 2011- V4 Exasol releases it’s first TPC-H benchmark results that show it’s blistering performance
  • 2012 – V4.1 UDF functionality for R, Python and LUA is introduced
  • 2013 – V4.2 Enterprise readiness, including resource management and connectivity
  • 2014 – V5 Improvements and features, plus new TPC-H results released (which are still unbeaten)
  • 2016 (~Q3) – V6 ….

Onto the long awaited version 6!

Version 6 seems packed with new features, so here follows just a handful of the new features and improvements, with more to follow:

Virtual Schemas

External data sources can be connected via Virtual Schemas. Using the external schema meta data, tables can be referenced “locally” within Exasol. This will support an “internal” to “external” join.

Any query using a virtual schema object will be forwarded to the connected data source.

Using Virtual schemas should provide agile access to current data, reduce redundancy, reduce the need for complex ETL and reduce disk space waste.

With this being the first iteration of Virtual schemas, an improvement has already been promised on this technology to come, by the means of an Intelligent cache.

Flexible Import

The improved import will provide a common framework for data imports. This framework will be available on GitHub for the Exasol user community to use and expand upon.

Version 6 will include as standard:

  • A generic JDBC adapter
  • Native Hadoop adapter, supporting all HDFS formats (by using native HCatalog)

In-Database Analytics

From V6, you can integrate ANY analytical programming language. UDFs will be able to be written in any language, so long as the language has been encapsulated into an isolated container. This will also enable a developer to use different versions of the same language simultaneously.

Again, this framework will be available on GitHub to download.

 

 

Image

Exasol Xperience 2016

IMG_20160606_165111.jpg

Tomorrow sees the start of Exasol’s Xperience 2016 event. It’s looking set to be a great event, with speakers coming from across the Big Data arena, including Andy Done, the Technical Director at King, Karsten Manski from Zalando, and Atheon’s very own Guy Cuthbert.

The event is to be split into two days, with the first being split into two breakout sessions, with one covering Advanced in database analytics, and the other Exasol in the Cloud, plus Hadoop integration.

The second day, sees sessions from some of the leaders in big data, discussing how they are overcoming data problems with Exasol, and also what promises to be an interesting look at data and beyond with Dr Hannah Fry, of University College London, for the key note speech.

I’ll be present for both days, so it will be great to catch up with any of you who have been visiting the site.