[Lxc-users] resize2fs

Sat Sep 4 21:16:27 UTC 2010

hi All,

I don't know, whether this is lxc releated, or only ext3.
The system is an uptodate Ubuntu Lucid 10.04 x86_64 .

I tried to resize a partition, unser an lxc container. I did it from the 
host. The partition was mounted on a subdirectory of the container. 
LXC's version is 0.7.2. The running kernel version is 2.6.32-24-server. 
There were running also libvirt based KVM machines.

resize2fs /dev/<lvm device>

This is in dmesg log:

[1956101.273405] INFO: task kjournald:1404 blocked for more than 120 
seconds.
[1956101.283985] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" 
disables this message.
[1956101.305932] kjournald     D ffff8800d4cdc1e8     0  1404      2 
0x00000000
[1956101.305942]  ffff88040fb17d30 0000000000000046 0000000000015bc0 
0000000000015bc0
[1956101.305963]  ffff88040f0303c0 ffff88040fb17fd8 0000000000015bc0 
ffff88040f030000
[1956101.305988]  0000000000015bc0 ffff88040fb17fd8 0000000000015bc0 
ffff88040f0303c0
[1956101.306023] Call Trace:
[1956101.306045]  [<ffffffff81214ad4>] 
journal_commit_transaction+0x174/0xe40
[1956101.306065]  [<ffffffff810586b0>] ? finish_task_switch+0x50/0xe0
[1956101.306083]  [<ffffffff81085090>] ? autoremove_wake_function+0x0/0x40
[1956101.306100]  [<ffffffff81077719>] ? try_to_del_timer_sync+0x79/0xd0
[1956101.306120]  [<ffffffff81218b4d>] kjournald+0xed/0x250
[1956101.306137]  [<ffffffff81085090>] ? autoremove_wake_function+0x0/0x40
[1956101.306152]  [<ffffffff81218a60>] ? kjournald+0x0/0x250
[1956101.306168]  [<ffffffff81084d16>] kthread+0x96/0xa0
[1956101.306187]  [<ffffffff810141ea>] child_rip+0xa/0x20
[1956101.306203]  [<ffffffff81084c80>] ? kthread+0x0/0xa0
[1956101.306218]  [<ffffffff810141e0>] ? child_rip+0x0/0x20
[1956101.306287] INFO: task imap:10964 blocked for more than 120 seconds.
[1956101.317210] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" 
disables this message.
[1956101.339043] imap          D 00000000ffffffff     0 10964  22403 
0x00000000
[1956101.339049]  ffff8801ae021d68 0000000000000086 0000000000015bc0 
0000000000015bc0
[1956101.339053]  ffff88000d51c890 ffff8801ae021fd8 0000000000015bc0 
ffff88000d51c4d0
[1956101.339057]  0000000000015bc0 ffff8801ae021fd8 0000000000015bc0 
ffff88000d51c890
[1956101.339061] Call Trace:
[1956101.339067]  [<ffffffff81218555>] log_wait_commit+0xc5/0x150
[1956101.339072]  [<ffffffff81085090>] ? autoremove_wake_function+0x0/0x40
[1956101.339076]  [<ffffffff8121275b>] journal_stop+0x26b/0x2b0
[1956101.339080]  [<ffffffff81212fd5>] ? journal_start+0xb5/0x100
[1956101.339083]  [<ffffffff81213047>] journal_force_commit+0x27/0x30
[1956101.339089]  [<ffffffff811c1fdb>] ext3_force_commit+0x2b/0x30
[1956101.339093]  [<ffffffff811b5be7>] ext3_sync_file+0x67/0x110
[1956101.339105]  [<ffffffff8116b981>] vfs_fsync_range+0xa1/0xe0
[1956101.339114]  [<ffffffff8116ba2d>] vfs_fsync+0x1d/0x20
[1956101.339124]  [<ffffffff8116ba6e>] do_fsync+0x3e/0x60
[1956101.339132]  [<ffffffff8116baa3>] sys_fdatasync+0x13/0x20
[1956101.339145]  [<ffffffff810131b2>] system_call_fastpath+0x16/0x1b
[1956101.339160] INFO: task imap:24652 blocked for more than 120 seconds.
[1956101.350612] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" 
disables this message.
[1956101.373914] imap          D ffff88021586d898     0 24652  22403 
0x00000000
[1956101.373919]  ffff8803eb21fd18 0000000000000082 0000000000015bc0 
0000000000015bc0
[1956101.373923]  ffff8801e53b31a0 ffff8803eb21ffd8 0000000000015bc0 
ffff8801e53b2de0
[1956101.373927]  0000000000015bc0 ffff8803eb21ffd8 0000000000015bc0 
ffff8801e53b31a0
[1956101.373932] Call Trace:
[1956101.373938]  [<ffffffff8104c98b>] ? mutex_spin_on_owner+0x8b/0xb0
[1956101.373947]  [<ffffffff815597b7>] __mutex_lock_slowpath+0xe7/0x170
[1956101.373952]  [<ffffffff815591f3>] mutex_lock+0x23/0x50
[1956101.373958]  [<ffffffff81146125>] lock_super+0x25/0x30
[1956101.373962]  [<ffffffff811bc44a>] ext3_orphan_add+0x3a/0x1b0
[1956101.373966]  [<ffffffff811b8ffd>] ? ext3_mark_inode_dirty+0x3d/0x50
[1956101.373970]  [<ffffffff811c016b>] ext3_unlink+0x28b/0x2a0
[1956101.373977]  [<ffffffff8114fdb2>] vfs_unlink+0xa2/0xf0
[1956101.373984]  [<ffffffff8115052a>] ? lookup_hash+0x3a/0x50
[1956101.373992]  [<ffffffff81151f46>] do_unlinkat+0x1a6/0x1d0
[1956101.374000]  [<ffffffff81148ea6>] ? sys_newlstat+0x36/0x50
[1956101.374008]  [<ffffffff81151f86>] sys_unlink+0x16/0x20
[1956101.374017]  [<ffffffff810131b2>] system_call_fastpath+0x16/0x1b
[1956101.374029] INFO: task resize2fs:28135 blocked for more than 120 
seconds.
[1956101.385117] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" 
disables this message.
[1956101.408850] resize2fs     D 0000000000000000     0 28135  27050 
0x00000000
[1956101.408854]  ffff88038f4b7bf8 0000000000000082 0000000000015bc0 
0000000000015bc0
[1956101.408856]  ffff8804163a9ab0 ffff88038f4b7fd8 0000000000015bc0 
ffff8804163a96f0
[1956101.408858]  0000000000015bc0 ffff88038f4b7fd8 0000000000015bc0 
ffff8804163a9ab0
[1956101.408861] Call Trace:
[1956101.408867]  [<ffffffff81212be9>] start_this_handle+0x209/0x430
[1956101.408870]  [<ffffffff81085090>] ? autoremove_wake_function+0x0/0x40
[1956101.408872]  [<ffffffff81212183>] ? __journal_file_buffer+0xd3/0x230
[1956101.408877]  [<ffffffff81212ed2>] journal_restart+0xc2/0x110
[1956101.408885]  [<ffffffff811c541f>] 
extend_or_restart_transaction+0x4f/0x70
[1956101.408895]  [<ffffffff811c6714>] setup_new_group_blocks+0x3f4/0x590
[1956101.408904]  [<ffffffff811c6dfb>] ext3_group_add+0x14b/0x470
[1956101.408915]  [<ffffffff811bbce2>] ext3_ioctl+0x382/0x6e0
[1956101.408925]  [<ffffffff812b8f16>] ? rb_erase+0xd6/0x160
[1956101.408938]  [<ffffffff811546a2>] vfs_ioctl+0x22/0xa0
[1956101.408950]  [<ffffffff815586d0>] ? thread_return+0x48/0x418
[1956101.408962]  [<ffffffff81154841>] do_vfs_ioctl+0x81/0x410
[1956101.408973]  [<ffffffff81154c51>] sys_ioctl+0x81/0xa0
[1956101.408985]  [<ffffffff8155b22e>] ? do_device_not_available+0xe/0x10
[1956101.409000]  [<ffffffff810131b2>] system_call_fastpath+0x16/0x1b
[1956101.409013] INFO: task clapf:28349 blocked for more than 120 seconds.
[1956101.420608] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" 
disables this message.
[1956101.444187] clapf         D 0000000000000000     0 28349  16283 
0x00000000
[1956101.444191]  ffff8801bba89bd8 0000000000000082 0000000000015bc0 
0000000000015bc0
[1956101.444194]  ffff880058579ab0 ffff8801bba89fd8 0000000000015bc0 
ffff8800585796f0
[1956101.444197]  0000000000015bc0 ffff8801bba89fd8 0000000000015bc0 
ffff880058579ab0
[1956101.444199] Call Trace:
[1956101.444207]  [<ffffffff81212be9>] start_this_handle+0x209/0x430
[1956101.444211]  [<ffffffff81085090>] ? autoremove_wake_function+0x0/0x40
[1956101.444220]  [<ffffffff81212fd5>] journal_start+0xb5/0x100
[1956101.444231]  [<ffffffff811c2201>] ext3_journal_start_sb+0x31/0x60
[1956101.444242]  [<ffffffff811be629>] ext3_create+0x59/0x120
[1956101.444256]  [<ffffffff8114dfb3>] ? generic_permission+0x23/0xc0
[1956101.444266]  [<ffffffff8114fa44>] vfs_create+0xb4/0xe0
[1956101.444276]  [<ffffffff8114fb34>] __open_namei_create+0xc4/0x110
[1956101.444287]  [<ffffffff811532db>] do_filp_open+0xa6b/0xba0
[1956101.444300]  [<ffffffff81114ea3>] ? do_wp_page+0xd3/0x850
[1956101.444310]  [<ffffffff81115d4c>] ? handle_mm_fault+0x2ec/0x3c0
[1956101.444322]  [<ffffffff8115e5ba>] ? alloc_fd+0x10a/0x150
[1956101.444333]  [<ffffffff81142309>] do_sys_open+0x69/0x170
[1956101.444343]  [<ffffffff81142450>] sys_open+0x20/0x30
[1956101.444354]  [<ffffffff810131b2>] system_call_fastpath+0x16/0x1b
[1956101.444362] INFO: task clapf:28389 blocked for more than 120 seconds.
[1956101.456299] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" 
disables this message.
[1956101.479650] clapf         D 0000000000000000     0 28389  16283 
0x00000000
[1956101.479654]  ffff8803dcd53e08 0000000000000082 0000000000015bc0 
0000000000015bc0
[1956101.479657]  ffff8803dfc531a0 ffff8803dcd53fd8 0000000000015bc0 
ffff8803dfc52de0
[1956101.479660]  0000000000015bc0 ffff8803dcd53fd8 0000000000015bc0 
ffff8803dfc531a0
[1956101.479662] Call Trace:
[1956101.479671]  [<ffffffff815597b7>] __mutex_lock_slowpath+0xe7/0x170
[1956101.479674]  [<ffffffff815591f3>] mutex_lock+0x23/0x50
[1956101.479678]  [<ffffffff81151e36>] do_unlinkat+0x96/0x1d0
[1956101.479681]  [<ffffffff8155d5e3>] ? do_page_fault+0x153/0x3b0
[1956101.479684]  [<ffffffff81151f86>] sys_unlink+0x16/0x20
[1956101.479695]  [<ffffffff810131b2>] system_call_fastpath+0x16/0x1b

After this processes were in state 'D'.

I restarted the host machine and run e2fsck -f, resize2fs and now it's 
working. Still I don't know, there wether there is some data loss.

Where should I report this?

I'm afraid, it's only ext3 related and not depending on lxc?

Thank you,

tamas