I assume there is a value metric that balances quantity with quantity that may be exploitable in our mid-gains period of understanding the tech behavior -- meaning potential gains from synthetic data. That said, I also expect no-free-lunch to kick in at some point, and synthetic data doesn't always pay attention to the data generating process for outliers.
You will find active learning interesting. It starts by attributing a value to each point in your domain that it learns to match the expected gain in some performance metric.
This metric can be learned so it’s okay if it’s really hard to specify.
