<html>
<head>
</head>
<body>
<div style="color: black;">
<div style="color: black;">
<p style="margin: 0 0 1em 0; color: black;">My 0.02</p>
<p style="margin: 0 0 1em 0; color: black;">We have been using btrfs in
production for more than a year on other projects and about 6mos with
LXD. It has been rock solid. I have multiple LXD servers each
with >20 containers. We have a separate btrfs filesystem (with
compression enabled) to store the LXD containers. I take nightly snapshots
for all containers, and each server probably has 2000 snapshots. The only
issue thus far is the IO hit when deleting lots of snapshots at one
time. You need to delete a few (10 at a time), pause for 60secs, then
delete the next 10.</p>
<p style="margin: 0 0 1em 0; color: black;">I have used ZFS in Linux in the
past and could never get adequate performance - regardless of tuning or
amount of RAM given to ZFS. In fact, I started using ZFS for our
backup server (64TB raw storage with 32GB RAM) but had to move back to XFS
due to severe performance issues. Nothing fancy; I did a by-the-bok
install and enabled compression and snapshots. I tried every tuning option
available (including SSD for L2-ARC). Nothing would improve the
performance.</p>
<p style="margin: 0 0 1em 0; color: black;">To the OP: are you sure btrfs
is causing your issues? Have you traced the OP activity during the
hiccup moments?</p>
</div>
<div style="color: black;">
<p
style="color: black; font-size: 10pt; font-family: Arial, sans-serif; margin: 10pt 0;">On
December 3, 2016 7:37:21 AM "Fajar A. Nugraha"
<list@fajar.net> wrote:</p>
<blockquote type="cite" class="gmail_quote"
style="margin: 0 0 0 0.75ex; border-left: 1px solid #808080; padding-left: 0.75ex;">
<div dir="ltr"><div class="gmail_extra"><div class="gmail_quote">On Sat,
Dec 3, 2016 at 6:01 PM, Sergiusz Pawlowicz <span dir="ltr"><<a
href="mailto:sergiusz@pawlowicz.name"
target="_blank">sergiusz@pawlowicz.name</a>></span>
wrote:<br><blockquote class="gmail_quote"
style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><span
class="gmail-">> You'd need to set arc to be as small as possible:<br>
> # cat /etc/modprobe.d/zfs-arc-max.<wbr>conf<br>
> options zfs zfs_arc_max=67108865<br>
<br>
</span>What is a sense of using ZFS if you don't use its cache? Non
sense. it<br>
</blockquote><div><br></div><div>- excellent integration with
lxd</div><div>- data integrity verification using checksum<br></div><div>-
thin-lvm-like space management</div><div>- send/receive</div><div>-
compression</div><div>- much more mature compared to
btrfs</div><div> </div><blockquote class="gmail_quote"
style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">will
work slower and less reliable than ext4.<br>
<span class="gmail-HOEnZb"><font
color="#888888"><br></font></span></blockquote><div><br></div><div>I never
said it was faster.</div><div><br></div><div>In general, zfs WILL be slower
- to some extent - compared to ext4. Just like ext4 (presumably with LVM
and raid/mirror) will be slower compared to writing to raw disk directly -
especially if you also exclude any kind of raid/mirror and volume
manager.</div><div><br></div><div>To give more perspective to my particular
use case, my EC2 zfsroot AMI only use 1GB EBS thanks to lz4 compression.
And that's with around 400 MB free space. Thanks to zfs snapshot/clone,
I can also use clones of my root as containers (which is more efficient
compared to LVM snapshots or overlay)</div><div><br></div><div>Is it a
suitable solution for everyone? No.</div><div>Does it work for my use case?
Yes. MUCH more so compared to ext4 or btrfs.</div><div>Will it work for
Pierce's use case? I believe
so.</div><div><br></div><div>-- </div><div>Fajar</div></div></div></div>
_______________________________________________<br>
lxc-users mailing list<br>
<a class="aqm-autolink aqm-autowrap"
href="mailto:lxc-users%40lists.linuxcontainers.org">lxc-users@lists.linuxcontainers.org</a><br>
<a class="aqm-autolink aqm-autowrap"
href="http://lists.linuxcontainers.org/listinfo/lxc-users">http://lists.linuxcontainers.org/listinfo/lxc-users</a></blockquote>
</div>
</div>
</body>
</html>