Stumbled upon https://github.com/FiloSottile/yubikey-agent via https://github.com/gopasspw/gopass/issues/1345#issuecomment-630293383 and frankly both look really amazing.