Build V project with Cosmopolitan

[EchoPouet]

Hello everyone,

I would like compile my project Bernard with Cosmopolitan and I'm having some difficulties.

I am developing under WLS 2 Ubuntu 24.04, using version 0.4.11 of V and version 14.1.0 of comopolitan.

My first command gives the following results:

$ v . -showcc -prod -show-c-output -cc cosmocc
failed thirdparty object build cmd:
'cosmocc' -std=gnu99 -D_DEFAULT_SOURCE   -O2 -DNDEBUG  -fPIC -D GC_THREADS=1 -D GC_BUILTIN_ATOMIC=1 -I "/home/echopouet/workspace/prog_lang/v/thirdparty/libgc/include" -o '/home/echopouet/.vmodules/.cache/ce/ceaa824afe6588944aa197aba3f5bf6b.module.builtin.o' -c '/home/echopouet/workspace/prog_lang/v/thirdparty/libgc/gc.c'
builder error: /home/echopouet/workspace/prog_lang/v/thirdparty/libgc/gc.c:1093:5: error: #error The collector has not been ported to this machine/OS combination
 1093 | #   error The collector has not been ported to this machine/OS combination
      |     ^~~~~
/home/echopouet/workspace/prog_lang/v/thirdparty/libgc/gc.c:3186:5: error: #error Bad word size
 3186 | #   error Bad word size
      |     ^~~~~
/home/echopouet/workspace/prog_lang/v/thirdparty/libgc/gc.c:3195:5: error: #error Bad pointer size
 3195 | #   error Bad pointer size
      |     ^~~~~
/home/echopouet/workspace/prog_lang/v/thirdparty/libgc/gc.c:4129:3: error: #error Get a real machine
 4129 | # error Get a real machine
      |   ^~~~~
/home/echopouet/workspace/prog_lang/v/thirdparty/libgc/gc.c:5716:33: error: 'CPP_WORDSZ' undeclared here (not in a function); did you mean 'CPP_PTRSZ'?
 5716 | #define PHT_SIZE (PHT_ENTRIES > CPP_WORDSZ ? PHT_ENTRIES / CPP_WORDSZ : 1)
      |                                 ^~~~~~~~~~
/home/echopouet/workspace/prog_lang/v/thirdparty/libgc/gc.c:5717:30: note: in expansion of macro 'PHT_SIZE'
 5717 | typedef word page_hash_table[PHT_SIZE];
      |                              ^~~~~~~~
/home/echopouet/workspace/prog_lang/v/thirdparty/libgc/gc.c: In function 'GC_get_main_stack_base':
/home/echopouet/workspace/prog_lang/v/thirdparty/libgc/gc.c:27178:9: error: #error None of HEURISTIC* and *STACKBOTTOM defined!
27178 | #       error None of HEURISTIC* and *STACKBOTTOM defined!
      |         ^~~~~
/home/echopouet/workspace/prog_lang/v/thirdparty/libgc/gc.c: In function 'GC_register_data_segments':
/home/echopouet/workspace/prog_lang/v/thirdparty/libgc/gc.c:27978:22: error: 'DATASTART' undeclared (first use in this function)
27978 |             if (ADDR(DATASTART) - 1U >= ADDR(DATAEND)) {
      |                      ^~~~~~~~~
/home/echopouet/workspace/prog_lang/v/thirdparty/libgc/gc.c:5001:25: note: in definition of macro 'ADDR'
 5001 | #define ADDR(p) ((word)(p))
      |                         ^
/home/echopouet/workspace/prog_lang/v/thirdparty/libgc/gc.c:27978:22: note: each undeclared identifier is reported only once for each function it appears in
27978 |             if (ADDR(DATASTART) - 1U >= ADDR(DATAEND)) {
      |                      ^~~~~~~~~
/home/echopouet/workspace/prog_lang/v/thirdparty/libgc/gc.c:5001:25: note: in definition of macro 'ADDR'
 5001 | #define ADDR(p) ((word)(p))
      |                         ^
/home/echopouet/workspace/prog_lang/v/thirdparty/libgc/gc.c: In function 'GC_unix_sbrk_get_mem':
/home/echopouet/workspace/prog_lang/v/thirdparty/libgc/gc.c:28115:28: error: implicit declaration of function 'sbrk' [-Wimplicit-function-declaration]
28115 |     ptr_t cur_brk = (ptr_t)sbrk(0);
      |                            ^~~~
/home/echopouet/workspace/prog_lang/v/thirdparty/libgc/gc.c:28115:21: warning: cast to pointer from integer of different size [-Wint-to-pointer-cast]
28115 |     ptr_t cur_brk = (ptr_t)sbrk(0);
      |                     ^
/home/echopouet/workspace/prog_lang/v/thirdparty/libgc/gc.c:28124:13: warning: cast to pointer from integer of different size [-Wint-to-pointer-cast]
28124 |         if ((ptr_t)sbrk((SBRK_ARG_T)GC_page_size - lsbs) == (ptr_t)(-1)) {
      |             ^
/home/echopouet/workspace/prog_lang/v/thirdparty/libgc/gc.c:28138:14: warning: cast to pointer from integer of different size [-Wint-to-pointer-cast]
28138 |     result = (ptr_t)sbrk((SBRK_ARG_T)bytes);
      |              ^
/home/echopouet/workspace/prog_lang/v/thirdparty/libgc/gc.c: In function 'GC_read_dirty':
/home/echopouet/workspace/prog_lang/v/thirdparty/libgc/gc.c:6314:37: error: passing argument 1 of 'memcpy' makes pointer from integer without a cast [-Wint-conversion]
 6314 | #   define GC_grungy_pages GC_arrays._grungy_pages
      |                            ~~~~~~~~~^~~~~~~~~~~~~~
      |                                     |
      |                                     int
/home/echopouet/workspace/prog_lang/v/thirdparty/libgc/gc.c:5308:32: note: in definition of macro 'BCOPY'
 5308 | #   define BCOPY(x,y,n) memcpy(y, x, (size_t)(n))
      |                                ^
/home/echopouet/workspace/prog_lang/v/thirdparty/libgc/gc.c:30109:57: note: in expansion of macro 'GC_grungy_pages'
30109 |         BCOPY(CAST_AWAY_VOLATILE_PVOID(GC_dirty_pages), GC_grungy_pages,
      |                                                         ^~~~~~~~~~~~~~~
In file included from /mnt/c/Users/echopouet/Developpement/cosmocc/include/stdlib.h:14,
                 from /home/echopouet/workspace/prog_lang/v/thirdparty/libgc/gc.c:440:
/mnt/c/Users/echopouet/Developpement/cosmocc/include/libc/str/str.h:29:14: note: expected 'void *' but argument is of type 'int'
   29 | void *memcpy(void *, const void *, size_t) memcpyesque;
      |              ^~~~~~
At top level:
cc1: note: rewrote 2 switch statements

There are a few errors when compiling the GC source file v/thirdparty/libgc/gc.c because “the collector has not been ported to this machine/OS combination.” Well, if I compile with the autofree option:

$ v . -showcc -prod -show-c-output -cc cosmocc -autofree
Compilation with unknown C compiler `cosmocc`
>> OBJECT FILE compilation cmd: 'cosmocc' -std=gnu99 -D_DEFAULT_SOURCE   -O2 -DNDEBUG  -fPIC -I "/home/echopouet/workspace/prog_lang/v/thirdparty/cJSON" -o '/home/echopouet/.vmodules/.cache/47/47476cd2797d07cab57f297e212251d8.module.json.o' -c '/home/echopouet/workspace/prog_lang/v/thirdparty/cJSON/cJSON.c'
> C compiler cmd: 'cosmocc' '@/tmp/v_1000/bernard.01K2PY4M01GBBHZNAKHBJKB24E.tmp.c.rsp'
> C compiler response file "/tmp/v_1000/bernard.01K2PY4M01GBBHZNAKHBJKB24E.tmp.c.rsp":
  -O2 -DNDEBUG "/home/echopouet/.vmodules/.cache/47/47476cd2797d07cab57f297e212251d8.module.json.o" -o '/mnt/c/Users/echopouet/Developpement/bernard/bernard' -I "/home/echopouet/workspace/prog_lang/v/thirdparty/cJSON" "/tmp/v_1000/bernard.01K2PY4M01GBBHZNAKHBJKB24E.tmp.c" -std=gnu99 -D_DEFAULT_SOURCE -lm -lpthread  
======== Output of the C Compiler (cosmocc) ========
cosmocc: fatal error: @/tmp/v_1000/bernard.01K2PY4M01GBBHZNAKHBJKB24E.tmp.c.rsp: no such file
compilation terminated.
====================================================

Now, cosmocc cannot find “@/tmp/v_1000/bernard.01K2PY4M01GBBHZNAKHBJKB24E.tmp.c.rsp,” but I can give it the commands contained in this file:

$ cosmocc -O2 -DNDEBUG "/home/echopouet/.vmodules/.cache/47/47476cd2797d07cab57f297e212251d8.module.json.o" -o '/mnt/c/Users/echopouet/Developpement/bernard/bernard' -I "/home/echopouet/workspace/prog_lang/v/thirdparty/cJSON" "/tmp/v_1000/bernard.01K2PY4M01GBBHZNAKHBJKB24E.tmp.c" -std=gnu99 -D_DEFAULT_SOURCE -lm -lpthread  
/tmp/v_1000/bernard.01K2PY4M01GBBHZNAKHBJKB24E.tmp.c: In function 'x__json2__Count_chars_in_struct_T_main__Prune':
/tmp/v_1000/bernard.01K2PY4M01GBBHZNAKHBJKB24E.tmp.c:15176:17: warning: implicit declaration of function '_option_Array_string_free'; did you mean '_option_Array_string_str'? [-Wimplicit-function-declaration]
15176 |                 _option_Array_string_free((Array_string*)workaround.data); // autofreed option var x.json2 false
      |                 ^~~~~~~~~~~~~~~~~~~~~~~~~
      |                 _option_Array_string_str
/mnt/c/Users/echopouet/Developpement/cosmocc/bin/../libexec/gcc/x86_64-linux-cosmo/14.1.0/ld.bfd: /tmp/fatcosmocc.ttr8wsr6w38l0.o: in function `x__json2__Count_chars_in_struct_T_main__Prune':
bernard.01K2PY4M01GBBHZNAKHBJKB24E.tmp.c:(.text+0x24d1b): undefined reference to `_option_Array_string_free'
/mnt/c/Users/echopouet/Developpement/cosmocc/bin/../libexec/gcc/x86_64-linux-cosmo/14.1.0/ld.bfd: /tmp/fatcosmocc.ttr8wsr6w38l0.o: in function `x__json2__Encoder_encode_struct_T_main__Prune':
bernard.01K2PY4M01GBBHZNAKHBJKB24E.tmp.c:(.text+0x2782f): undefined reference to `_option_Array_string_free'
/mnt/c/Users/echopouet/Developpement/cosmocc/bin/../libexec/gcc/x86_64-linux-cosmo/14.1.0/ld.bfd: bernard.01K2PY4M01GBBHZNAKHBJKB24E.tmp.c:(.text+0x27a7f): undefined reference to `_option_Array_string_free'
/mnt/c/Users/echopouet/Developpement/cosmocc/bin/../libexec/gcc/x86_64-linux-cosmo/14.1.0/ld.bfd: bernard.01K2PY4M01GBBHZNAKHBJKB24E.tmp.c:(.text+0x27a96): undefined reference to `_option_Array_string_free'
collect2: error: ld returned 1 exit status

This is now a link error with the error “undefined reference to ‘_option_Array_string_free’”.
The problem is in the json module with autofree option activated and not cosmocc because I have the same errors with gcc:

$ v . -showcc -prod -show-c-output -cc gcc -autofree
>> OBJECT FILE compilation cmd: 'gcc' -std=gnu99 -D_DEFAULT_SOURCE   -fwrapv -O3 -flto -DNDEBUG  -fPIC -I "/home/echopouet/workspace/prog_lang/v/thirdparty/cJSON" -o '/home/echopouet/.vmodules/.cache/0f/0f1e92e38735d7af6971268e2da933c4.module.json.o' -c '/home/echopouet/workspace/prog_lang/v/thirdparty/cJSON/cJSON.c'
> C compiler cmd: 'gcc' '@/tmp/v_1000/bernard.01K2PZ9G7QTKJ4RC42NFZDPCYS.tmp.c.rsp'
> C compiler response file "/tmp/v_1000/bernard.01K2PZ9G7QTKJ4RC42NFZDPCYS.tmp.c.rsp":
  -fwrapv -O3 -flto -DNDEBUG "/home/echopouet/.vmodules/.cache/0f/0f1e92e38735d7af6971268e2da933c4.module.json.o" -o '/mnt/c/Users/echopouet/Developpement/bernard/bernard' -I "/home/echopouet/workspace/prog_lang/v/thirdparty/cJSON" "/tmp/v_1000/bernard.01K2PZ9G7QTKJ4RC42NFZDPCYS.tmp.c" -std=gnu99 -D_DEFAULT_SOURCE -lm -lpthread  
======== Output of the C Compiler (gcc) ========
/tmp/v_1000/bernard.01K2PZ9G7QTKJ4RC42NFZDPCYS.tmp.c: In function ‘x__json2__Count_chars_in_struct_T_main__Prune’:
/tmp/v_1000/bernard.01K2PZ9G7QTKJ4RC42NFZDPCYS.tmp.c:15176:17: warning: implicit declaration of function ‘_option_Array_string_free’; did you mean ‘_option_Array_string_str’? [-Wimplicit-function-declaration]
15176 |                 _option_Array_string_free((Array_string*)workaround.data); // autofreed option var x.json2 false
      |                 ^~~~~~~~~~~~~~~~~~~~~~~~~
      |                 _option_Array_string_str
lto-wrapper: warning: using serial compilation of 6 LTRANS jobs
lto-wrapper: note: see the ‘-flto’ option documentation for more information
/usr/bin/ld: /tmp/ccJvwsLz.ltrans3.ltrans.o: in function `x__json2__Encoder_encode_struct_T_main__Config.constprop.0':
<artificial>:(.text+0x9a98): undefined reference to `_option_Array_string_free'
/usr/bin/ld: <artificial>:(.text+0xa026): undefined reference to `_option_Array_string_free'
/usr/bin/ld: <artificial>:(.text+0xa043): undefined reference to `_option_Array_string_free'
/usr/bin/ld: /tmp/ccJvwsLz.ltrans2.ltrans.o: in function `main__install_service':
<artificial>:(.text+0xb1e7): undefined reference to `_option_Array_string_free'
collect2: error: ld returned 1 exit status
================================================

The last solution is to change my code to manually free up memory and use the -manualfree option, but I don't want to modify my code for that.

Do you have any other solutions ? It's a problem in Cosmopolitan or V ? Have you ever worked on a project with Cosmopolitan?

[JalonSolov]

To compile without the gc, you have to add -gc none. Adding -autofree does not affect whether or not gc is used. It is used even with -autofree, as there are some things the compiler cannot determine at compile time, so gc covers those.

As far as gc goes, there are plans for a pure V gc in the works, though there is nothing currently available for use. Once that is in place, though, none of us have to worry about libgc any longer.

[EchoPouet]

Thanks for your feedback. @JalonSolov The plan to create pure V GC is to translate Bohem, which is already used in V, right?

I'll write a ticket about my latest error with -autofree and json, as it appears with GCC.

[EchoPouet]

The issue for -autofree and x.jons2 : #25124

[Wajinn]

It might be interesting to put in an issue about Bohem at the Cosmopolitan repo. They may come up with some resolution, workaround, or at least give an additional perspective.