Current-Users archive
[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index][Old Index]
Re: cmake hanging
Hi,
And another very similar; this time making wip/emacs-git, at the
beginning of the clone process
...
Find the GDB manual and other documentation resources online at:
[38/47295]
<http://www.gnu.org/software/gdb/documentation/>.
For help, type "help".
Type "apropos word" to search for commands related to "word".
Attaching to process 23291
Reading symbols from /usr/pkg/libexec/git-core/git...
(No debugging symbols found in /usr/pkg/libexec/git-core/git)
[New LWP 28957 of process 23291]
[New LWP 558 of process 23291]
[New LWP 23291 of process 23291]
Reading symbols from /usr/pkg/lib/libpcre2-8.so.0...
(No debugging symbols found in /usr/pkg/lib/libpcre2-8.so.0)
Reading symbols from /usr/lib/libz.so.1...
(No debugging symbols found in /usr/lib/libz.so.1)
Reading symbols from /usr/pkg/lib/libiconv.so.2...
(No debugging symbols found in /usr/pkg/lib/libiconv.so.2)
Reading symbols from /usr/lib/libintl.so.1...
(No debugging symbols found in /usr/lib/libintl.so.1)
Reading symbols from /usr/lib/libpthread.so.1...
(No debugging symbols found in /usr/lib/libpthread.so.1)
Reading symbols from /usr/lib/libc.so.12...
(No debugging symbols found in /usr/lib/libc.so.12)
Reading symbols from /usr/lib/i18n/libUTF8.so.5.0...
(No debugging symbols found in /usr/lib/i18n/libUTF8.so.5.0)
Reading symbols from /usr/libexec/ld.elf_so...
(No debugging symbols found in /usr/libexec/ld.elf_so)
[Switching to LWP 26184 of process 23291]
0x00000000005d9d19 in ubc_check ()
(gdb) thread apply all bt
Thread 4 (LWP 23291 of process 23291):
#0 0x00007769a444551a in _lwp_wait () from /usr/lib/libc.so.12
#1 0x00007769a4c0c8c4 in pthread_join () from /usr/lib/libpthread.so.1
#2 0x0000000000441c50 in cmd_index_pack ()
#3 0x00000000004053fe in handle_builtin ()
#4 0x0000000000406301 in cmd_main ()
#5 0x00000000005ea9a3 in main ()
Thread 3 (LWP 558 of process 23291):
#0 0x00000000005da8fd in ubc_check ()
#1 0x00000000005d9853 in sha1_process ()
#2 0x00000000005d996e in SHA1DCUpdate.part.0 ()
#3 0x0000000000594de8 in write_object_file_prepare ()
#4 0x00000000005976d7 in hash_object_file ()
#5 0x0000000000440940 in resolve_delta ()
#6 0x0000000000440a96 in find_unresolved_deltas ()
#7 0x0000000000441191 in threaded_second_pass ()
#8 0x00007769a4c0c6bc in ?? () from /usr/lib/libpthread.so.1
#9 0x00007769a4492370 in ?? () from /usr/lib/libc.so.12
#10 0x0000000000000000 in ?? ()
Thread 2 (LWP 28957 of process 23291):
#0 0x00000000005d7b04 in sha1_process ()
#1 0x00000000005d996e in SHA1DCUpdate.part.0 ()
#2 0x0000000000594de8 in write_object_file_prepare ()
#3 0x00000000005976d7 in hash_object_file ()
#4 0x0000000000440940 in resolve_delta ()
#5 0x0000000000440a96 in find_unresolved_deltas ()
#6 0x0000000000441191 in threaded_second_pass ()
#7 0x00007769a4c0c6bc in ?? () from /usr/lib/libpthread.so.1
#8 0x00007769a4492370 in ?? () from /usr/lib/libc.so.12
#9 0x0000000000000000 in ?? ()
Thread 1 (LWP 26184 of process 23291):
#0 0x00000000005d9d19 in ubc_check ()
#1 0x00000000005d9853 in sha1_process ()
#2 0x00000000005d996e in SHA1DCUpdate.part.0 ()
#3 0x0000000000594de8 in write_object_file_prepare ()
--Type <RET> for more, q to quit, c to continue without paging--
#4 0x00000000005976d7 in hash_object_file ()
#5 0x0000000000440940 in resolve_delta ()
#6 0x0000000000440a96 in find_unresolved_deltas ()
#7 0x0000000000441191 in threaded_second_pass ()
#8 0x00007769a4c0c6bc in ?? () from /usr/lib/libpthread.so.1
#9 0x00007769a4492370 in ?? () from /usr/lib/libc.so.12
#10 0x0000000000000000 in ?? ()
(gdb)
....
On Sat, 6 Jun 2020 at 18:45, Chavdar Ivanov <ci4ic4%gmail.com@localhost> wrote:
>
> On Sat, 6 Jun 2020 at 18:43, Chavdar Ivanov <ci4ic4%gmail.com@localhost> wrote:
> >
> > Hi,
> >
> > I got another cmake hang during pkg_rolling-replace today, while
> > building misc/kdepimlibs4, trace as follows:
>
> Just to mention that after I quit gdb and detached from the process it
> continued and completed the build . . .
>
>
> >
> > . . . .
> >
> > Find the GDB manual and other documentation resources online at:
> >
> > [190/47198]
> > <http://www.gnu.org/software/gdb/documentation/>.
> >
> > For help, type "help".
> > Type "apropos word" to search for commands related to "word".
> > Attaching to process 18255
> > Reading symbols from /usr/pkg/bin/cmake...
> > (No debugging symbols found in /usr/pkg/bin/cmake)
> > [New LWP 11876 of process 18255]
> > [New LWP 22853 of process 18255]
> > [New LWP 24648 of process 18255]
> > [New LWP 19500 of process 18255]
> > [New LWP 14244 of process 18255]
> > [New LWP 704 of process 18255]
> > [New LWP 876 of process 18255]
> > [New LWP 18255 of process 18255]
> > Reading symbols from /usr/lib/libexecinfo.so.0...
> > (No debugging symbols found in /usr/lib/libexecinfo.so.0)
> > Reading symbols from /usr/lib/libexpat.so.2...
> > (No debugging symbols found in /usr/lib/libexpat.so.2)
> > Reading symbols from /usr/lib/libz.so.1...
> > (No debugging symbols found in /usr/lib/libz.so.1)
> > Reading symbols from /usr/lib/libarchive.so.4...
> > (No debugging symbols found in /usr/lib/libarchive.so.4)
> > Reading symbols from /usr/pkg/lib/libcurl.so.4...
> > (No debugging symbols found in /usr/pkg/lib/libcurl.so.4)
> > Reading symbols from /usr/pkg/lib/libuv.so.1...
> > Reading symbols from /usr/lib/libcrypto.so.14...
> > (No debugging symbols found in /usr/lib/libcrypto.so.14)
> > Reading symbols from /usr/lib/libstdc++.so.9...
> > (No debugging symbols found in /usr/lib/libstdc++.so.9)
> > Reading symbols from /usr/lib/libm.so.0...
> > (No debugging symbols found in /usr/lib/libm.so.0)
> > Reading symbols from /usr/lib/libgcc_s.so.1...
> > (No debugging symbols found in /usr/lib/libgcc_s.so.1)
> > Reading symbols from /usr/lib/libpthread.so.1...
> > (No debugging symbols found in /usr/lib/libpthread.so.1)
> > Reading symbols from /usr/lib/libc.so.12...
> > --Type <RET> for more, q to quit, c to continue without paging--
> > (No debugging symbols found in /usr/lib/libc.so.12)
> > (No debugging symbols found in /usr/lib/libelf.so.2)
> >
> > [149/47198]
> > Reading symbols from /usr/lib/libbz2.so.1...
> > (No debugging symbols found in /usr/lib/libbz2.so.1)
> > Reading symbols from /usr/lib/liblzma.so.2...
> > (No debugging symbols found in /usr/lib/liblzma.so.2)
> > Reading symbols from /usr/pkg/lib/libnghttp2.so.14...
> > (No debugging symbols found in /usr/pkg/lib/libnghttp2.so.14)
> > Reading symbols from /usr/pkg/lib/libidn2.so.0...
> > (No debugging symbols found in /usr/pkg/lib/libidn2.so.0)
> > Reading symbols from /usr/pkg/lib/librtmp.so.0...
> > (No debugging symbols found in /usr/pkg/lib/librtmp.so.0)
> > Reading symbols from /usr/pkg/lib/libgnutls.so.30...
> > (No debugging symbols found in /usr/pkg/lib/libgnutls.so.30)
> > Reading symbols from /usr/pkg/lib/libp11-kit.so.0...
> > Reading symbols from /usr/pkg/lib/libffi.so.7...
> > (No debugging symbols found in /usr/pkg/lib/libffi.so.7)
> > Reading symbols from /usr/pkg/lib/libunistring.so.2...
> > (No debugging symbols found in /usr/pkg/lib/libunistring.so.2)
> > Reading symbols from /usr/pkg/lib/libtasn1.so.6...
> > (No debugging symbols found in /usr/pkg/lib/libtasn1.so.6)
> > Reading symbols from /usr/lib/libintl.so.1...
> > (No debugging symbols found in /usr/lib/libintl.so.1)
> > Reading symbols from /usr/pkg/lib/libhogweed.so.6...
> > Reading symbols from /usr/pkg/lib/libgmp.so.10...
> > (No debugging symbols found in /usr/pkg/lib/libgmp.so.10)
> > Reading symbols from /usr/pkg/lib/libnettle.so.8...
> > Reading symbols from /usr/pkg/lib/libssh2.so.1...
> > (No debugging symbols found in /usr/pkg/lib/libssh2.so.1)
> > Reading symbols from /usr/lib/libssl.so.14...
> > (No debugging symbols found in /usr/lib/libssl.so.14)
> > Reading symbols from /usr/lib/libgssapi.so.11...
> > (No debugging symbols found in /usr/lib/libgssapi.so.11)
> > Reading symbols from /usr/lib/libkvm.so.6...
> > (No debugging symbols found in /usr/lib/libkvm.so.6)
> > Reading symbols from /lib/libcrypt.so.1...
> > (No debugging symbols found in /lib/libcrypt.so.1)
> > Reading symbols from /usr/lib/libkrb5.so.27...
> > --Type <RET> for more, q to quit, c to continue without paging--
> > (No debugging symbols found in /usr/lib/libkrb5.so.27)
> > Reading symbols from /usr/lib/libasn1.so.10...
> > Reading symbols from /usr/lib/libcom_err.so.8...
> >
> > [108/47198]
> > (No debugging symbols found in /usr/lib/libcom_err.so.8)
> > Reading symbols from /usr/lib/libroken.so.20...
> > (No debugging symbols found in /usr/lib/libroken.so.20)
> > Reading symbols from /usr/lib/libheimbase.so.2...
> > (No debugging symbols found in /usr/lib/libheimbase.so.2)
> > Reading symbols from /usr/lib/libheimntlm.so.5...
> > (No debugging symbols found in /usr/lib/libheimntlm.so.5)
> > Reading symbols from /usr/lib/libhx509.so.6...
> > (No debugging symbols found in /usr/lib/libhx509.so.6)
> > Reading symbols from /usr/lib/libwind.so.1...
> > (No debugging symbols found in /usr/lib/libwind.so.1)
> > Reading symbols from /usr/lib/libsqlite3.so.1...
> > (No debugging symbols found in /usr/lib/libsqlite3.so.1)
> > Reading symbols from /usr/lib/libutil.so.7...
> > (No debugging symbols found in /usr/lib/libutil.so.7)
> > Reading symbols from /usr/libexec/ld.elf_so...
> > (No debugging symbols found in /usr/libexec/ld.elf_so)
> > [Switching to LWP 24143 of process 18255]
> > 0x00007c0aeeca87aa in ___lwp_park60 () from /usr/lib/libc.so.12
> > (gdb)
> > (gdb) bt
> > #0 0x00007c0aeeca87aa in ___lwp_park60 () from /usr/lib/libc.so.12
> > #1 0x00007c0aef40a97d in pthread_cond_timedwait () from
> > /usr/lib/libpthread.so.1
> > #2 0x00007c0af00a0214 in
> > std::condition_variable::wait(std::unique_lock<std::mutex>&) () from
> > /usr/lib/libstdc++.so.9
> > #3 0x00000000004a7c13 in cmWorkerPoolInternal::Work(unsigned int) ()
> > #4 0x00007c0af009e53a in ?? () from /usr/lib/libstdc++.so.9
> > #5 0x00007c0aef40c6bc in ?? () from /usr/lib/libpthread.so.1
> > #6 0x00007c0aeec92370 in ?? () from /usr/lib/libc.so.12
> > #7 0x0000000000000000 in ?? ()
> > (gdb) thread apply all bt
> >
> > Thread 9 (LWP 18255 of process 18255):
> > #0 0x00007c0aeec44d3a in _sys___kevent50 () from /usr/lib/libc.so.12
> > #1 0x00007c0aef407938 in __kevent50 () from /usr/lib/libpthread.so.1
> > #2 0x00007c0af0a1d79e in uv__io_poll (loop=loop@entry=0x7c0af1d96000,
> > timeout=<optimized out>) at src/unix/kqueue.c:214
> > #3 0x00007c0af0a0fc87 in uv_run (loop=0x7c0af1d96000,
> > mode=UV_RUN_DEFAULT) at src/unix/core.c:381
> > #4 0x00000000004a948a in cmWorkerPoolInternal::Process() ()
> > #5 0x00000000004a94d4 in cmWorkerPool::Process(void*) ()
> > #6 0x00000000004731d4 in (anonymous namespace)::cmQtAutoMocUicT::Process() ()
> > #7 0x000000000067009c in cmQtAutoGenerator::Run(cm::string_view,
> > cm::string_view) ()
> > [68/47198]
> > #8 0x0000000000462e22 in cmQtAutoMocUic(cm::string_view, cm::string_view) ()
> > #9 0x00000000004186d5 in
> > cmcmd::ExecuteCMakeCommand(std::vector<std::__cxx11::basic_string<char,
> > std::char_traits<char>, std::allocator<char> >,
> > std::allocator<std::__c
> > xx11::basic_string<char, std::char_traits<char>, std::allocator<char>
> > > > > const&) ()
> > #10 0x00000000007652ea in main ()
> >
> > Thread 8 (LWP 876 of process 18255):
> > #0 0x00007c0aeeca87aa in ___lwp_park60 () from /usr/lib/libc.so.12
> > #1 0x00007c0aef40a97d in pthread_cond_timedwait () from
> > /usr/lib/libpthread.so.1
> > #2 0x00007c0af00a0214 in
> > std::condition_variable::wait(std::unique_lock<std::mutex>&) () from
> > /usr/lib/libstdc++.so.9
> > #3 0x00000000004a7c13 in cmWorkerPoolInternal::Work(unsigned int) ()
> > #4 0x00007c0af009e53a in ?? () from /usr/lib/libstdc++.so.9
> > #5 0x00007c0aef40c6bc in ?? () from /usr/lib/libpthread.so.1
> > #6 0x00007c0aeec92370 in ?? () from /usr/lib/libc.so.12
> > #7 0x0000000000400000 in ?? ()
> > #8 0x00007c0ae7200000 in ?? ()
> > #9 0x0000001003a0efff in ?? ()
> > #10 0x00007c0ae70000c0 in ?? ()
> > #11 0x00000000001fff40 in ?? ()
> > #12 0x0000000000000000 in ?? ()
> >
> > Thread 7 (LWP 704 of process 18255):
> > #0 0x00007c0aeeca87aa in ___lwp_park60 () from /usr/lib/libc.so.12
> > #1 0x00007c0aef4096fd in ?? () from /usr/lib/libpthread.so.1
> > #2 0x00007c0aeecd6d0a in je_malloc_mutex_lock_slow () from /usr/lib/libc.so.12
> > #3 0x00007c0aeed0e4f1 in je_arena_choose_hard () from /usr/lib/libc.so.12
> > #4 0x00007c0aeecb583f in je_tsd_tcache_data_init () from /usr/lib/libc.so.12
> > #5 0x00007c0aeecb5a89 in je_tsd_tcache_enabled_data_init () from
> > /usr/lib/libc.so.12
> > #6 0x00007c0aeecb1b09 in je_tsd_fetch_slow () from /usr/lib/libc.so.12
> > #7 0x00007c0aeed0e82d in malloc () from /usr/lib/libc.so.12
> > --Type <RET> for more, q to quit, c to continue without paging--
> > #8 0x00007c0af00b35d6 in operator new(unsigned long) () from
> > /usr/lib/libstdc++.so.9
> > #9 0x00007c0af010463a in std::basic_filebuf<char,
> > std::char_traits<char> >::_M_allocate_internal_buffer() () from
> > /usr/lib/libstdc++.so.9
> > #10 0x00007c0af01052cd in std::basic_filebuf<char,
> > std::char_traits<char> >::open(char const*, std::_Ios_Openmode) ()
> > from /usr/lib/libstdc++.so.9
> > #11 0x0000000000670e97 in
> > cmQtAutoGenerator::FileRead(std::__cxx11::basic_string<char,
> > std::char_traits<char>, std::allocator<char> >&,
> > std::__cxx11::basic_string<char,
> > std::char_traits<char>, std::allocator<char> > const&,
> > std::__cxx11::basic_string<char, std::char_traits<char>,
> > std::allocator<char> >*) ()
> > #12 0x0000000000460dbf in (anonymous
> > namespace)::cmQtAutoMocUicT::JobParseT::ReadFile() ()
> > #13 0x000000000046c037 in (anonymous
> > namespace)::cmQtAutoMocUicT::JobParseHeaderT::Process() ()
> > #14 0x00000000004a7b50 in cmWorkerPoolInternal::Work(unsigned int) ()
> > #15 0x00007c0af009e53a in ?? () from /usr/lib/libstdc++.so.9
> > #16 0x00007c0aef40c6bc in ?? () from /usr/lib/libpthread.so.1
> >
> > [28/47198]
> > #17 0x00007c0aeec92370 in ?? () from /usr/lib/libc.so.12
> > #18 0x0000000000000000 in ?? ()
> >
> > Thread 6 (LWP 14244 of process 18255):
> > #0 0x00007c0aeeca87aa in ___lwp_park60 () from /usr/lib/libc.so.12
> > #1 0x00007c0aef40a97d in pthread_cond_timedwait () from
> > /usr/lib/libpthread.so.1
> > #2 0x00007c0af00a0214 in
> > std::condition_variable::wait(std::unique_lock<std::mutex>&) () from
> > /usr/lib/libstdc++.so.9
> > #3 0x00000000004a7c13 in cmWorkerPoolInternal::Work(unsigned int) ()
> > #4 0x00007c0af009e53a in ?? () from /usr/lib/libstdc++.so.9
> > #5 0x00007c0aef40c6bc in ?? () from /usr/lib/libpthread.so.1
> > #6 0x00007c0aeec92370 in ?? () from /usr/lib/libc.so.12
> > Backtrace stopped: Cannot access memory at address 0x7c0ae5be0000
> >
> > Thread 5 (LWP 19500 of process 18255):
> > #0 0x00007c0aeeca87aa in ___lwp_park60 () from /usr/lib/libc.so.12
> > #1 0x00007c0aef40a97d in pthread_cond_timedwait () from
> > /usr/lib/libpthread.so.1
> > #2 0x00007c0af00a0214 in
> > std::condition_variable::wait(std::unique_lock<std::mutex>&) () from
> > /usr/lib/libstdc++.so.9
> > #3 0x00000000004a7c13 in cmWorkerPoolInternal::Work(unsigned int) ()
> > #4 0x00007c0af009e53a in ?? () from /usr/lib/libstdc++.so.9
> > #5 0x00007c0aef40c6bc in ?? () from /usr/lib/libpthread.so.1
> > #6 0x00007c0aeec92370 in ?? () from /usr/lib/libc.so.12
> > #7 0x0000000000200000 in ?? ()
> > #8 0x0000000000000000 in ?? ()
> >
> > Thread 4 (LWP 24648 of process 18255):
> > #0 0x00007c0aeeca87aa in ___lwp_park60 () from /usr/lib/libc.so.12
> > #1 0x00007c0aef40a97d in pthread_cond_timedwait () from
> > /usr/lib/libpthread.so.1
> > #2 0x00007c0af00a0214 in
> > std::condition_variable::wait(std::unique_lock<std::mutex>&) () from
> > /usr/lib/libstdc++.so.9
> > #3 0x00000000004a7c13 in cmWorkerPoolInternal::Work(unsigned int) ()
> > --Type <RET> for more, q to quit, c to continue without paging--
> > #4 0x00007c0af009e53a in ?? () from /usr/lib/libstdc++.so.9
> > #5 0x00007c0aef40c6bc in ?? () from /usr/lib/libpthread.so.1
> > #6 0x00007c0aeec92370 in ?? () from /usr/lib/libc.so.12
> > #7 0x0000000000200000 in ?? ()
> > #8 0x0000000000000000 in ?? ()
> >
> > Thread 3 (LWP 22853 of process 18255):
> > #0 0x00007c0aeeca87aa in ___lwp_park60 () from /usr/lib/libc.so.12
> > #1 0x00007c0aef40a97d in pthread_cond_timedwait () from
> > /usr/lib/libpthread.so.1
> > #2 0x00007c0af00a0214 in
> > std::condition_variable::wait(std::unique_lock<std::mutex>&) () from
> > /usr/lib/libstdc++.so.9
> > #3 0x00000000004a7c4a in cmWorkerPoolInternal::Work(unsigned int) ()
> > #4 0x00007c0af009e53a in ?? () from /usr/lib/libstdc++.so.9
> > #5 0x00007c0aef40c6bc in ?? () from /usr/lib/libpthread.so.1
> > #6 0x00007c0aeec92370 in ?? () from /usr/lib/libc.so.12
> > #7 0x0000000000200000 in ?? ()
> > #8 0x0000000000000000 in ?? ()
> >
> > Thread 2 (LWP 11876 of process 18255):
> > #0 0x00007c0aeeca87aa in ___lwp_park60 () from /usr/lib/libc.so.12
> > #1 0x00007c0aef40a97d in pthread_cond_timedwait () from
> > /usr/lib/libpthread.so.1
> > #2 0x00007c0af00a0214 in
> > std::condition_variable::wait(std::unique_lock<std::mutex>&) () from
> > /usr/lib/libstdc++.so.9
> > #3 0x00000000004a7c13 in cmWorkerPoolInternal::Work(unsigned int) ()
> > #4 0x00007c0af009e53a in ?? () from /usr/lib/libstdc++.so.9
> > #5 0x00007c0aef40c6bc in ?? () from /usr/lib/libpthread.so.1
> > #6 0x00007c0aeec92370 in ?? () from /usr/lib/libc.so.12
> > #7 0x0000000000000000 in ?? ()
> >
> > Thread 1 (LWP 24143 of process 18255):
> > #0 0x00007c0aeeca87aa in ___lwp_park60 () from /usr/lib/libc.so.12
> > #1 0x00007c0aef40a97d in pthread_cond_timedwait () from
> > /usr/lib/libpthread.so.1
> > #2 0x00007c0af00a0214 in
> > std::condition_variable::wait(std::unique_lock<std::mutex>&) () from
> > /usr/lib/libstdc++.so.9
> > #3 0x00000000004a7c13 in cmWorkerPoolInternal::Work(unsigned int) ()
> > #4 0x00007c0af009e53a in ?? () from /usr/lib/libstdc++.so.9
> > #5 0x00007c0aef40c6bc in ?? () from /usr/lib/libpthread.so.1
> > #6 0x00007c0aeec92370 in ?? () from /usr/lib/libc.so.12
> > #7 0x0000000000000000 in ?? ()
> > (gdb)
> >
> > ....
> >
> > On Sat, 30 May 2020 at 10:31, Chavdar Ivanov <ci4ic4%gmail.com@localhost> wrote:
> > >
> > > On Sun, 24 May 2020 at 17:11, Chavdar Ivanov <ci4ic4%gmail.com@localhost> wrote:
> > > >
> > > > On Sun, 24 May 2020 at 16:39, Joerg Sonnenberger <joerg%bec.de@localhost> wrote:
> > > > >
> > > > > On Sun, May 24, 2020 at 09:22:41AM +0100, Chavdar Ivanov wrote:
> > > > > > While doing pkg_rolling-replace on amd64 -current from yesterday, I
> > > > > > got three times in a row a hang in cmake as the followingL
> > > > >
> > > > > Please attach with gdb and run "thread apply all bt" and give me the
> > > > > result. There are still two issues in/around cmake I'm trying to
> > > > > identify, so it would be interesting to know which of the two you are
> > > > > hitting.
> > > >
> > > > Will do if I hit it again; I restarted pkg_rolling-replace and it has
> > > > been going well since then.
> > >
> > > I tried in a short (10x) loop to build and clean the package which
> > > caused cmake to hang; it didn't take place.
> > >
> > > >
> > > > >
> > > > > Joerg
> > > >
> > > > Chavdar
> > > >
> > > > --
> > > > ----
> > >
> > >
> > >
> > > --
> > > ----
> >
> >
> >
> > --
> > ----
>
>
>
> --
> ----
--
----
Home |
Main Index |
Thread Index |
Old Index