“It has been 2 years of the Gemini program and GDM. We have come a good distance in that point with many efforts we must always really feel very pleased with. At the identical time competitors has accelerated immensely and the ultimate race to AGI is afoot. I believe we’ve all of the elements to win this race however we’re going to must turbocharge our efforts.
Code issues most — AGI will occur with takeoff, when the Al improves itself. Probably initially it is going to be with lots of human assist so a very powerful is our code efficiency. Furthermore this must work on our personal 1p code. We must be essentially the most environment friendly coder and Al scientists on this planet by utilizing our personal Al.
Productivity — In my expertise about 60 hours per week is the candy spot of productiveness. Some people put in much more however can burn out or lose creativity. Quite a lot of people work lower than 60 hours and a small quantity put within the naked minimal to get by. This final group shouldn’t be solely unproductive but additionally might be extremely demoralizing to everybody else.
Location — It is necessary to work within the workplace as a result of bodily being collectively is way more practical for communication than gve and so forth. And, due to this fact it’s good to be bodily colocated with others engaged on the identical factor. We want to attenuate reporting traces throughout international locations, cities, and buildings. I like to recommend being within the workplace no less than each week day.
Organization — We have to have clear duty and group with excessive functioning teams with shared administration and expertise management.
Simplicity — Lets use easy options the place we will. Eg if prompting works, simply try this, don’t posttrain a separate mannequin. No pointless technical complexities (resembling lora). Ideally we are going to really have one recipe and one mannequin which may merely be prompted for various makes use of.
Excellence — whether or not it’s an eval or an information supply or a dashboard or a message in an inside Ul, please ensure all of them work and all are good.
Speed — we’d like our merchandise, fashions, inside instruments to be quick. Can’t wait 20 minutes to run a little bit of python on borg.
Iterate at small scale — we’d like numerous concepts that we will take a look at shortly. The greatest means to do that is small scale experiments till you’ll be able to ramp up and hopefully see growing benefit at scale. This is a wonderful validation. Working an excessive amount of at simply giant scale has a behavior of minor tweaking and overfitting to evals, checkpoint sniping, and so forth. We want actual wins that scale.
No punting — we will’t hold constructing nanny merchandise. Our merchandise are overrun with filters and punts of assorted varieties. We want succesful merchandise and [to] belief our customers.“
