As far as that goes, Oracle prohibits the installation of their database on btrfs (note 2290489.1: "Oracle DB has specifically said that they do not support using BTRFS filesystems... BTRFS is optimized for non-database workloads.").
XFS for databases is what is used on tpc.org, but perhaps these new improvements may help.
Unfortunately, as best as I can tell you can’t shrink an XFS volume other than by completely rewriting it. (Also mkfs.xfs formats with Y2038-susceptible 32-bit timestamps by default, but that can be overriden.)