Hadoop Streaming Confidential

Warning: This is a short tech article.  To my usual readers that come here to read my cute daddy-daughter stories, please feel free to skip this one.

If you are working with hadoop streaming with python and see the following error in your logs:

Caused by: java.io.IOException: Cannot run program "my_mapper.py": error=2, 
    No such file or directory

What you should do is check the shebang at the top of your python script.  And make sure that the python executable is located in the same location on EVERY node of your cluster.

So, if your shebang is:

#!/opt/python/bin/python

Verify that /opt/python/bin/python is located exists on every node. Otherwise, when you try to run your hadoop streaming job, you’ll receive the error from above, when one of the nodes tries to run the python script.

Let me know in the comments below if this helped you. Thanks.

Posted in coding, hadoop | Tagged , , , | Leave a comment

Piano Confidential

a

The family piano was the piano I grew up with.  When I was kid around middle school age, my piano playing progressed so much that it was obvious that playing on consumer keyboard wasn’t enough for me anymore.  My mother and I went to a piano store one day and I picked out the piano that I had wanted.  It was a simple black console.  My mother slowly paid it off over the years.

My piano followed me through life.  It was around  through college, my grad school years, my first programming job, and then marriage.  I always had to get a ground floor apartment, because there was no way I was getting the piano up all those stairs

When my wife and I bought a house, I was finally relieved.  I could have finally have my own piano room.  And most importantly, I didn’t have to worry about upsetting my neighbors anymore.

That all changed when we started having kids.

My eldest daughter, who’s now two, had always been around my piano playing.  But then one morning when I started my usual practice routine, my daughter stops playing with her toys and comes up to me by my side.  She starts tapping up on arm to get my attention.

I look down at her and she says, “My Nano!”
“Your piano?” I say.
“Yeah! My Nano!”

I guess this is what I get for having my piano room double as her play room.

Posted in Parenting, piano, random | Tagged , | Leave a comment

What Dreams May Come

One of the things my wife always found strange about me is that I always try to listen to my dreams.  If I strongly remember a dream after waking up, I try to gleam any useful information from them.  Often, I find that these dreams are my subconscious screaming to tell me something.

We’re all familiar with stories of others who do this.  Like how movie director, James Cameron, got the idea of Terminator from a dream he had.  The dream was of a man who had ripped his skin off to reveal a robot skeleton underneath.  Or the classic story of Elias Howe, he was trying to invent the first ever sewing machine and couldn’t get past a problem he had been having.  Then one night he had a nightmare of being cooked by island natives.  The next day he remembered the unique spears the natives had and this was the inspiration of solving the problem with threading the needle for his machine.

So here are a few of my dreams.
Once, I had a strange dream of going out and buying record player.  I don’t know why, but I did.  And in the dream once the record player was in my hands, I woke up.  I couldn’t go back to sleep.

I spent the rest of the night reading up on record players.  I knew I wanted a new and not a used one.  I bookmarked what I wanted and since it was close to my birthday, it was my gift from my wife.

That first night I played the record player, I couldn’t believe the experience.  I still kept my childhood records from the 80s and began to play them one by one.  I was immediately transported back to the 80s.  These were songs I hadn’t heard in 25+ years.  These were songs that don’t get played on radio, or used in tv or movies, or put into commercials.  And I knew all the lyrics.

It reminded my of my youth.

Another dream I had took place a few years into the future and in the dream I was browsing around a shopping mall with my wife.  Going from store to store, I noticed that each store had some sort of Disney merchandise.  It was everywhere.  In the dream, I thought to myself, “I should buy some stock in Disney.”

When I woke up the next day, I decided to listen to that and bought shares in DIS for no reason other than I had a dream.  Didn’t bother with any research.

The stock is up 25% from where I bought it.

So, I have had a few more dream that I haven’t acted on yet.  They seem to be more complex and need sometime to make happen.  Some require learning a new skill.  Some require me to save some money to purchase.

But so far, it’s been a pretty good ride.

Posted in general, random | Tagged | 1 Comment

Broccoli Confidential

This is a fun story from the first year of my marriage.

One day my wife and I were shopping at a Super Target.  We had stopped in to pick up a few groceries for the big meal my wife had planned for cooking that day.  We were buying mostly produce that day.

At the checkout, I watched the girl cashier ring us up.  First, she rang up all the non-produce items, which weren’t very many.  Then she started on the produce items.  She would pick up the produce, weigh the produce, look up the produce code in her book, and enter the produce code in her register.  This went on for a bit.

Then everything stopped at the last item.  It was broccoli.  She picked up the broccoli looked at and gave it a weird look.  She went into her book, flipped through the pages, and didn’t find what she was looking for.  And she did it again.  Looking.  Looking.  Searching. Searching.  And she still couldn’t find what she was looking for.  I didn’t know what the problem was.

Then she asks, “What do you call this?”

Without hesitation I said, “Baby Trees”.

I busted out laughing when she took me seriously and tried to find it in her little book.  My wife saved her and told her I was joking and the name was broccoli.

I still find this story funny.

Posted in random | Tagged , , , , , | 2 Comments

Piano: Getting to the Next Level

As many of you know, I’ve been studying jazz and blues piano intently for the past few years.  I finally found a teacher that gets me and understands my music goals.

I’ve improved a lot in the short few years.  My wife recently commented on how quickly I’m able to play and embellish a new tune from any Fake Book now.  I’m shocked how fast I can grab jazz chords now.

I’m pleased with my progress so far.  But, I fear reaching a plateau in my skill level.  I want to get that effortless sound in my playing.

How do I get to that next level?  These are two thing I want to learn to do more of in 2014.

Memorizing.
I’ve never been good at memorizing songs.  I’ve always played with a lead sheet or sheet music or even just notes of the chords.  When I was a kid, memorizing my music for a performance was often frustrating leading to traumatic experiences.  So, I avoided it all these years.

But today, when I talk to my musician friends, the friends who can outplay me, they all say the same thing: start memorizing your music.

When you think about it, all the professional pianists out there memorize.  It’s hard to imagine paying a lot of money to see concert pianist playing out of book.  It’s hard to imagine someone like %% do the same.

I hope by practicing memorization, it gets “my head out of the book” and more intently listening to what I’m playing.  And that the more I do it, the easier and less traumatic it becomes.

Recording.
I also plan to record myself practicing and listening back to the recording during my train rides to work.

I feel that when you’re playing, you might not hear the nuances in your music.  I hope by constantly hearing my playback, it slowly and changes the way I perform and approach the piano.

The difficulty in doing this is not the act of recording.  That’s easy.  You just hit the REC button.  It’s regularly going back the next day listening to it and finding all the uncaught mistakes and places for improvement.  And I mean, listening to the WHOLE recording, not just spot checking here and there.

Right now, I’ve been using the Voice Memo app that’s already installed on my iPhone. Which gets the job done, but not the greatest recording.  Also, sometimes the app will stop recording at some random point during my practice session.  I hope to get a dedicated handheld recorder for musicians soon.

I hope these two approaches get me to that next level for 2014.

Posted in piano | Tagged , , | Leave a comment

Raising A Star Wars Kid

a.3It’s been almost 2 years since I’ve written about sharing Star Wars with my eldest daughter.  Since then, she has been learning to recognize her Star Wars characters.

With the help of one of my wife’s friends, we got these amazing toddler friendly action figures.  And then, I use a shortened version of the characters’ names that a 2-year-old can say. “Vader” for Darth Vader.  “Chewie” for Chewbacca.  “Fett” for Boba Fett.

It has been fun going to the toy aisle at the store and quiz her.  “Olivia, who’s this?” “VADER!”  “Olivia, who’s this?” “YODA!”

The best part of this update was when all of us went to an evening Christmas dinner at our church.  And at each dinner table, the church had set up a Nativity set for the children to assemble and play with.

The Nativity set on our table was made of ebony, so the statuettes were all jet black.  I picked up one of the wise men and asked my daughter, “Olivia, who’s this?”

And her loud and proud answer?

“VADER!”

My wife busted out laughing.

b

Posted in Parenting | Tagged , , , , , , , , , | Leave a comment

5 Things This Nerdy Dad Wants to Share with His Daughters

3_crop

This is a list of 5 things this Nerdy Dad wants to share with his daughters as they grow up.

5) Eating

My eldest daughter has already shown signs that she’s an adventurous eater and I hope her new baby sister takes after her. My eldest tastes every new food that’s placed in front of her.

She’s been discovering her own likes and dislikes this way, and she really expresses her dislike of something.   But I’m proud that she’s willing to try anything.   She doesn’t reject anything before she tastes it.

I hope both girls becomes foodies like my wife and I and learn the joy of going out and experiencing new restaurants, especially adventurous places.  As they get older, I hope to have daddy-daughter-and-daughter dates to places like The Publican.  I hope to also to introduce them to other cuisine like Filipino and African.

4) Video Games

I’ve debated if this should be on my list.  I don’t see myself any time soon playing first-person shooters with my daughters.  However, when they are a little older I would love to play games like Plants Vs. Zombies and maybe some Mario and Zelda.

I think the most important thing is that I play along with my daughters.  When each one of them gets a new high score, beats a new level, or discover a new game secret, I want to share in those game accomplishments.

3) Movies

I love movies.  My favorite of course being Star Wars and I can’t wait to share with them the experience of taking them to see the new ones when they’re released.  But I enjoy classics like Casa Blanca and Ben-Hur.  And Westerns like A Fistful of Dollars and True Grit. And of course musicals like Westside Story, Wizard of Oz, The Music Man, and Man of La Mancha.  I have already put together a list of my favorite movies to watch with them as they get older.

I also don’t want movies to be passive entertainment.  I hope to use movies as a gateway to explore creativity.  Such as:

  •     Creative Writing – By writing our own movie scripts or by writing better endings to movies that fell flat
  •     Acting
  •     Movie Production – Creating our own movie shorts. Using the computer to construct simple movies and special effects
  •     The list goes on …

2) Programming

Of course, I’m going to be adding computer programming to list.  It’s too important.  No matter what field each girl decides to go into, being able to program will be vital.  Being able to program just adds to your resume.  A candidate with a little bit programming stands out among the sea of resumes.

I’m not the only Nerdy Dad finds this important.  Other Dads in my office frequently talk about getting our little ones to start thinking about programming.

We talk about Scratch, an educational programming language.  We talk about Lego Mindstorms and other programmable toys.  We want to know what each Dad in the office has been up to, talking about what has been working and not working with our kids.

1) Music

Music is important part of my life and I want it to also be an important part of in both my daughters’ lives.

My eldest, who is 2-years-old, has already claimed my piano as her own, climbing up onto the piano bench and plunking down on the keys all while singing.  She recognizes the piano as a means to create music.  I’m shocked that she can already tell the difference between printed sheet music and regular print that’s in her books.

Like movies, I want them to be active participants and not passive listeners.  I want to see them dance to the beat, create their own songs, improvise, sing, express the joys and sadness of their lives like I have.

I hope by encouraging them to learn, to create, and enjoy the nerdy things I love makes them daring and bold young women.

Posted in general, Parenting | Tagged , , , , , , , , | Leave a comment