It’s not horrible – SnapLogic

We see a lot of “Best in class”, “Cutting edge (or bleeding even…)”, etc. But what if we are happy with good enough? What if we do not want to spend thousands of dollars? You don’t need a harvester to mow your lawn, same in IT, you don’t always need the most powerful thing.

In this cycle of articles, I will try and talk about some of those. First, something I use at my job – SnapLogic.

SnapLogic is something called and ETL (Extract, Transform, Load), it takes data from different sources, transforms it into a common format and allows to download/update/delete it. Quite a lot of competition in this space with Microsoft’s SSIS being a powerhouse but it is expensive in the long run and requires some degree of knowledge to use.

SnapLogic on the other hand

Like building Lego’s, you take a reader, snap it to a parser, perform actions on it and then save it somewhere else. From my experience building them is actually a lot of fun, and it’s harder to make mistakes because due to endings being distinct you can easily see what will and won’t snap together.

It’s not perfect:

  • It automatically assigns types to data, and lacks a proper casting mechanism for their main “anonymous” type “any”.
  • The snaps have a fixed length leading to you having to add “dummy” ones just so you can snap two sequences together
  • The editor for their scripting language lacks proper IntelliSense
  • If you want to build your own things you are constrained to JavaScript

But it is good enough and we have a lot of success with it in our company, so when you get the chance give SnapLogic a chance, it’s not horrible.