The amount of improvements in speed and resource usage i've seen happening in the last few days since the LLaMA LLM model release is staggering. There is a lot of room for improvement, no doubt.
Looking at the bigger picture:
- Moore's law is slowing down
- The cost for ever shrinking transistors is exploding
- Energy costs are soaring
- Planetwide, we need to get rid of non renewable power sources ASAP
Thus, efficient hardware and software should be on everyone's priority list, even if developers are expensive.
Looking at the bigger picture:
- Moore's law is slowing down
- The cost for ever shrinking transistors is exploding
- Energy costs are soaring
- Planetwide, we need to get rid of non renewable power sources ASAP
Thus, efficient hardware and software should be on everyone's priority list, even if developers are expensive.