UPDATE: Works on CachyOS as well.

UPDATE: I got everything up and running on a Fedora system as well using the above guide. Including sound and function keys. After installing the function keys, go into the Fedora settings > keyboard and select "Google | Chromebook" in the dropdown.

So, you have just installed Linux and run all the updates including the graphics drivers. Did you know that the Nvidia drivers you are using might not be the latest ones supported? OK, here's a tip for you.
Open the Linux start menu and search for Software Sources and open it.
Go to the tab called PPAs
Click on add
Add <code>ppa:graphics-drivers/ppa</code> and hit OK
Find Driver Manager in the start menu and open it
There should now be updated drivers.
Good luck.

Thanks to Mutahar for the tips.

Popular Distros

Linux is a family of open source Unix-like operating systems based on the Linux kernel, an operating system kernel first released on September 17, 1991, by Linus Torvalds. Linux is typically packaged as a Linux distribution, which includes the kernel and supporting system software and libraries, most of which are provided by third parties to create a complete operating system, designed as a clone of Unix and released under the copyleft GPL license. Thousands of Linux distributions exist, many based directly or indirectly on other distributions; popular Linux distributions include Debian, Fedora Linux, Linux Mint, Arch Linux, and Ubuntu, while commercial distributions include Red Hat Enterprise Linux, SUSE Linux Enterprise, and ChromeOS. Linux distributions are frequently used in server platforms.

Very helpful, thanks!

Also worth mentioning is that I got the screen up side down in Ubuntu at first start up. This is easily fixed and can be done without standing on your head. Simple press 'Ctrl+Alt+T' and enter to open the terminal.
xrandr -o normal  

Prepare by downloading the Ubuntu flavour of choice from the official Ubuntu website. Make a bootable Ubuntu USB with Rufus following this tutorial.
Enabling Developer Mode
Entering Developer Mode requires you to first boot into Recovery Mode. For Chromebooks, this means pressing [ESC+Refresh+Power]; On Chromeboxes, there is usually a physical recovery button (often a small hole above the SD card reader) which must be depressed when powering on. Once at the recovery screen, press [CTRL+D] to enable developer mode, then confirm when prompted. As a security measure, transitioning to/from Developer Mode will wipe out all ChromeOS user data, essentially powerwashing (resetting) the device.
Exiting Developer Mode is as simple as following the instructions on the Developer Mode boot screen (usually pressing [SPACE]), but may require resetting the firmware boot flags if you've changed them. As with entering developer mode, exiting will wipe all ChromeOS user data, so if you plan on keeping your device in developer mode, it's a good idea to set the firmware boot flags to prevent accidental exiting and loss of data.
Getting a (Root-capable) Shell
Once in developer mode, there are two ways to get a root-capable shell, which is required for doing anything useful:
NOTE: Starting with ChromeOS R117, this script must be run from a VT2 terminal (from login screen: [CTRL+ALT+F2], login chronos); it cannot be run from a crosh shell ([CTRL+ALT+T] when logged in) due to the removal of sudo, or from a crostini (penguin) terminal; crostini is a virtualized container and lacks the necessary access to read or modify the firmware.
On the login screen, press [Ctrl+Alt+F2] (F2 is right-arrow on ChromeOS keyboards), then login with user 'chronos' (no password is required, nor should one be set)
When logged in (as a guest is ok) and with a browser window open, press [Ctrl+Alt+T], then type shell and press [ENTER]
Once you have a root-capable shell, you can do things like install Linux (via crouton or chrx), update the firmware, etc.
Installing the Firmware and Boot From USB
Then follow the steps below or go here. In this tutorial we will be installing the RW_LEGACY Firmware which allows us to boot from USB and Try/Install Ubuntu (or any other flavor). It is also the only option that works without removing read/write protection from you Chromebook.
Logged into your Chromebox, press Ctrl+Alt+T to open the terminal.
In the terminal, write 'shell'.
Then run the next three commands one by one.
cd; curl -LO mrchromebox.tech/firmware-util.shsudo install -Dt /usr/local/bin -m 755 firmware-util.shsudo firmware-util.shAfter the commands you should be presented with this

Press '1' on your keyboard.
You will be presented with a message that says "If N, always boot from internal storage unless selected from boot menu".
We want to press 'y' here. This makes your Chromebook always boot into Ubuntu when starting up.
Let the firmware install. Once done, a green message should appear saying "RW_LEGACY firmware successfully installed/updated."
Press 'Enter'
Power off your Chromebook and power it on again
This time, instead of pressing 'Ctrl+D', press 'Ctrl+L' and then press '1' followed by 'Esc' to enter the boot menu.
Select your USB
From here on it's pretty straight forward. Try Ubuntu, make sure things work. Then you can install, completely replacing Chrome OS or install it on another USB/Memory card.
---
In order to get audio working, open the terminal and write in the following commands in order and then reboot your machine. Make sure you have python and git installed if it doesn't come with the distro you use.
git clone https://github.com/WeirdTreeThing/chromebook-linux-audio
cd chromebook-linux-audio
./setup-audio
 ---
To get the function keys to work properly (lower/raise volume, brightness etc) run the following commands in a terminal. As per above, git must be installed.
git clone https://github.com/WeirdTreeThing/cros-keyboard-map
cd cros-keyboard-map
./install.sh