Actually...I don't know if that was the video. Matthew Flaschen over at StackOverflow had this to say on whether or not one could (or should) program in binary:
"Of course. It's more commonly called
machine code. It's basically
assembly language without the mnemonic devices. Someone who knows assembly very well could program in machine code with additional effort, referring to opcode listings (e.g.
x86) as needed.
Would I do it? No. Even assembly is only useful in rare circumstances, and there's no reason (beside demonstrating your skills) to reject the
assembler's help."
So essentially, it IS possible. But it's incredibly tedious.