Here's a wonderful example of live programming in an introspectable system like Emacs.
Emacs lets you customise ('advise') any function. Today I advised code evaluation! With a record of code snippets recently executed, I can make my code completion smarter.