1. More RAM in your local device.
2 Faster CPU in your local device
3. Faster data connection.
4. Ask google to do it on a faster server.
5. Ask google to rewrite the app to make it faster.
What "memory" do you mean? Storage on the disk or RAM? RAM usage is determined by the design, the programming language and the programmer. Only Google knows why it uses what it uses and only Google can make it less.
Since there are many cloud storage and file sharing services, consider switching to one that you like better.
No matter on which type of device, opening google drive is like making watching a turtle run a marathon.
Is there any possible way to make it faster and why the fudge does it take so much memory anyways??(as compared to icloud's built in noting apps).
TIA

Chowhound
Comic Vine
GameFAQs
GameSpot
Giant Bomb
TechRepublic