RSSAmplifier

Blog

Rathboma's blog

Ramblings of an indie open source business owner.

rathboma.comRSS feed ↗57 posts

Latest posts

How to use Vue2 with Vite 8+

Our new NPM package maintains Vue.js 2.7 build capabilities for Vite 8+, thanks to the Vue2 community

Should you use Parquet?

Parquet provides significant benefits for sparse reads of large datasets, but is it always the file format to use?

Beginners Guide to Columnar File Formats in Spark and Hadoop

File formats can be confusing, so lets delve into Columnar file formats (like Parquet) and explain why they're different to regular formats (like CSV, JSON, or Avro)

A Quick Guide to Concurrency in Scala

I'll talk through the basics of Threads, Akka, Futures, and Timers in this quick overview of concurrency for Scala. Great for those building apps in Scala.

4 Fun and Useful Things to Know about Scala's apply() functions

Scala's apply functions are commonly seen alongside case classes, but they can do so much more. Here are 4 fun ways they are used in Scala.

10+ Great Books and Resources for Learning and Perfecting Scala

While Scala is amazing it has an overwhelming number of features. These books and on-line resources will help you learn and perfect Scala whether you're coming from Java, Python, Ruby, or any other language.

10+ Great Books for Apache Spark

Apache Spark is a powerful technology with some fantastic books. I'll help you choose which book to buy with my guide to the top 10+ Spark books on the market.

An Introduction to Hadoop and Spark Storage Formats (or File Formats)

I'll walk through what we mean when we talk about 'storage formats' or 'file formats' for Hadoop and give you some initial advice on what format to use and how.

Is it 'MapReduce' or 'Map Reduce'?

Confused about whether Map Reduce is one word or two? Let me settle this once and for all.

Type-Safe Scalding MapReduce Tutorial - Joining and Summarizing Data

Scalding's scala-like API lets us join and summarize data quickly and easily, but beware -- it looks like regular scala, but sometimes behaves differently.

Hadoop MapReduce Advanced Python Join Tutorial with Example Code

Joining and analysing data in Hadoop using Python MapReduce. I compare this solution to the same solution in other MapReduce frameworks.

5 Industry Veterans Pick Their Favorite MapReduce Frameworks

Software engineers from Cloudera, Foursquare, Spredfast, JauntVR, and Elondina chat with me about their favorite Hadoop MapReduce frameworks and why they like them.

Apache Spark Java Tutorial [Code Walkthrough With Examples]

To follow my post implementing a pipeline in regular Spark, I do the same thing with Java. The walkthrough includes open source code and unit tests.

Apache Spark Scala Tutorial [Code Walkthrough With Examples]

I implement a realistic pipeline in Spark as part of my series on Hadoop frameworks. The walkthrough includes open source code and a unit test.

Apache Hive vs MySQL - What are the key differences?

Apache Hive differs significantly from traditional relational databases like MySQL. I'll walk through some key differences in architecture and use cases to give a sense of when and why to use each technology.

Scalding Hadoop MapReduce Tutorial [Code Walkthrough With Examples]

How to implement some real world code with Scalding, a Scala wrapper for Cascading

Apache Hive Customization Tutorial Series

How to implement all sorts of custom functions for hive, including complex functions like 'sum()', 'count()', and 'explode()'

Cascading MapReduce Hadoop Tutorial with Examples

How to use Java & Cascading to perform a left outer join. Includes a comparison with Hive, Pig, and Java Mapreduce

8 SQL-on-Hadoop frameworks worth checking out

A rundown of the common query engines for Hadoop, with some of their pros/cons

Data Warehousing and Hadoop 2014 Survey

A survey on data warehousing and Hadoop Deployments. Tell me what problems are you having - I'd love to help you fix them.

Reading data from HDFS programatically using java (and scala)

How to read files from hdfs using Java and Scala, even if they are compressed, using any FileSystem implementation.

Hadoop Python MapReduce Tutorial for Beginners

A step-by-step tutorial for writing your first map reduce with Python and Hadoop Streaming.

Hadoop MapReduce Scoobi Tutorial with Examples

How to use Scala & Scoobi to perform a left outer join. Includes a comparision with Hive, Pig, and Java Mapreduce

Hadoop Hive UDF Tutorial - Extending Hive with Custom Functions

a walk-through (with code) of writing user defined functions (UDFs) for Apache Hive. There are two APIs, so my walkthrough will include examples for both.

15+ Great Books for Hadoop

A compilation of books for Hadoop and related projects (hive, pig, hbase, etc).

A Beginners Guide to Hadoop

What is Hadoop - A high level overview of Hadoop without going in to too much technical detail.

Real World Hadoop - Implementing a Left Outer Join in Pig

How to use Pig to perform a left outer join. Includes a comparison with Hive and regular Java Map Reduce.

Simple Check-in now has more features

blog post by Matthew Rathbone

Real World Hadoop - Implementing a Left Outer Join in Hive

How to use hive to perform a left outer join. Includes a comparison with performing the same query in java map reduce.

An Excellent Hadoop Resouce - The Hadoop Weekly Newsletter

Real World Hadoop Implementing A Left Outer Join In Hadoop Map Reduce

Auto indenting text in Sublime Text 2

An exciting feature of sublime text 2 I never knew about.

Hadoop MapReduce Framework Tutorials with Examples

A constantly expanding list of 12+ hadoop frameworks, with code examples and documentation links

Do you spend hours formatting word documents?

How to Format References in APA Style using Microsoft Word 2011 for Mac OSX

step-by-step guide to formatting references in APA, with screenshots.

How to do 'find and replace' within currently selected text in Microsoft Word 2011 for Mac OSX

Adding scaladocs to a Scala function in Sublime Text 2

A useful Sublime Text 2 plugin for scala users

Game Programming in Scala with Libgdx and Box2D

a walkthrough and code for building games with scala using libgdx and box2d.

Simple Check-in 'Unknown Error' bug is fixed!

One touch check-ins for foursquare

Scrolling past the end of a file in Sublime Text 2

A hidden feature of sublime text 2 that you can't possibly live without.

Tips for using CDH's Hadoop Distribution with Amazon's S3

How to have page numbers start on page 3 using MS Word 2011 for Mac

a step-by-step walkthrough for adding custom page number layouts to Microsoft Word using section breaks and a lot of clicking

GeoPop - My First Android Game

[link] Beginning Android Game Development Book

Adding JARS to hive without using ADD JAR

an alternative setup for deploying jars to hive.

The start of an online puzzle community?

Some fun Hadoop and Hive Bugs

A Warning About Apache Thrift's Asynchronous Clients

It has been a good week