This talk will give an overview of the technical aspects of building the Gavagai Living Lexicon. We will discuss both the underlying architecture, and the underlying distributional semantic models, and we will provide some examples of the types of poblems we have encountered applying distributional semantic models to large-scale streaming data.