CI: Use own package as base

So we can skip updating and installing the same packages a million times. It will still grab the hex.pm stuff -- maybe we can find a way to avoid this, too.