Labeled Data Is All We Need

(I realize that this has very little to directly do with astronomy or music, but I wanted to post this so there's a record. I should also mention that the text below was generated by claude.ai, with substantial prompting from myself.  It reflects my sentiments very well.)

Labeled Data Is All We Need

Preface: Looking Forward – Short-Term

In the coming days, I will establish a website where Foundation Models (FMs) can purchase and utilize data I am personally recording and curating. The labeled datasets will match the quality and format of those available from established sources like Hugging Face and AWS. Upon purchase, buyers will receive non-exclusive rights to use the data for training and testing purposes. New data will be continuously added to support ongoing Foundation Model development. Pricing details are currently to be determined.

While selling datasets to Foundation Models is not a novel concept, I observe a lack of individual contributors and a scarcity of unique, high-quality data. Though I often find myself ahead of technological trends, this particular initiative seems somewhat more aligned with current market movements.

I've long recognized my tendency to conceptualize ideas well before their widespread adoption. Typically, my innovative thinking outpaces my resources to fully develop these concepts. In this instance, however, I feel more synchronized with emerging industry trends. Comments from thought leaders like Ilya Sutskever and the recent Stargate Project announcement have validated my approach.

The Stargate Project's proposed $500 billion budget—approximately $342 million daily—intrigued me. I contemplated their potential expenditures: power infrastructure (potentially nuclear), computational resources for model training and prediction generation, and data storage. The critical question emerged: Why massive storage if, as Ilya suggests, no new data exists?

The answer became clear: In the same talk that Ilya said that we were out of data, he also said that "data is the fossil fuel of AI”.  I would put it another way, but that's the basic idea.  Foundation Models require substantial new labeled datasets from high-quality sources. My work directly addresses this emerging market need.

This whole idea has been compelling me for about a year. It crystallized after hearing the Stargate Project announcement, making me realize the potential market for carefully curated, high-quality data.

My professional focus will now be collecting and curating labeled data for Foundation Models.

Other major work that I'm doing -- astronomical research, and advanced robotics -- will continue.  No stopping either of these from happening.