{ "id": 589123, "title": "How many cores do we have?", "url": "/competitions/ariel-data-challenge-2025/discussion/589123", "author_name": "SolverWorld", "post_date": "2025-07-10T12:02:17.575000", "votes": 2, "comment_count": 1, "views": 0, "content": "

I seem to recall that in the past, Kaggle notebooks had 4 cores if you did not attach a GPU, 2 if you did.
\nNow, it seems like you only get 2 no matter the GPU status. A quick test with multiprocessing shows about 2x speed up with a pool=2 but no benefit to more than 2.

\n

/proc/cpuinfo shows 4 processors, each with 2 cores. Hmm

\n
!cat //cpuinfo =>    : 0    :\ncpu    : 6        : 79 name    : Xeon(R) @ 2.20GHz    : 0    : 0xffffffff MHz        : 2200.162 size    : 56320\nphysical    : 0    : 4 id        : 0 cores    : 2        : 0 apicid    : 0        :\nfpu_exception    :\ncpuid    : 13        :\nflags        : vme pse msr mce apic mtrr mca pat clflush fxsr sse2 ht nx rdtscp constant_tsc nopl nonstop_tsc tsc_known_freq pclmulqdq fma pcid sse4_2 movbe aes avx rdrand lahf_lm 3dnowprefetch ssbd ibpb fsgsbase bmi1 avx2 bmi2 invpcid rdseed smap arat arch_capabilities        : spectre_v1 spec_store_bypass mds taa retbleed\nbogomips    : 4400.32 size    : 64    : 64 sizes    : 46 physical, 48 virtual management:    : 1    :\ncpu    : 6        : 79 name    : Xeon(R) @ 2.20GHz    : 0    : 0xffffffff MHz        : 2200.162 size    : 56320\nphysical    : 0    : 4 id        : 1 cores    : 2        : 2 apicid    : 2        :\nfpu_exception    :\ncpuid    : 13        :\nflags        : vme pse msr mce apic mtrr mca pat clflush fxsr sse2 ht nx rdtscp constant_tsc nopl nonstop_tsc tsc_known_freq pclmulqdq fma pcid sse4_2 movbe aes avx rdrand lahf_lm 3dnowprefetch ssbd ibpb fsgsbase bmi1 avx2 bmi2 invpcid rdseed smap arat arch_capabilities        : spectre_v1 spec_store_bypass mds taa retbleed\nbogomips    : 4400.32 size    : 64    : 64 sizes    : 46 physical, 48 virtual management:    : 2    :\ncpu    : 6        : 79 name    : Xeon(R) @ 2.20GHz    : 0    : 0xffffffff MHz        : 2200.162 size    : 56320\nphysical    : 0    : 4 id        : 0 cores    : 2        : 1 apicid    : 1        :\nfpu_exception    :\ncpuid    : 13        :\nflags        : vme pse msr mce apic mtrr mca pat clflush fxsr sse2 ht nx rdtscp constant_tsc nopl nonstop_tsc tsc_known_freq pclmulqdq fma pcid sse4_2 movbe aes avx rdrand lahf_lm 3dnowprefetch ssbd ibpb fsgsbase bmi1 avx2 bmi2 invpcid rdseed smap arat arch_capabilities        : spectre_v1 spec_store_bypass mds taa retbleed\nbogomips    : 4400.32 size    : 64    : 64 sizes    : 46 physical, 48 virtual management:    : 3    :\ncpu    : 6        : 79 name    : Xeon(R) @ 2.20GHz    : 0    : 0xffffffff MHz        : 2200.162 size    : 56320\nphysical    : 0    : 4 id        : 1 cores    : 2        : 3 apicid    : 3        :\nfpu_exception    :\ncpuid    : 13        :\nflags        : vme pse msr mce apic mtrr mca pat clflush fxsr sse2 ht nx rdtscp constant_tsc nopl nonstop_tsc tsc_known_freq pclmulqdq fma pcid sse4_2 movbe aes avx rdrand lahf_lm 3dnowprefetch ssbd ibpb fsgsbase bmi1 avx2 bmi2 invpcid rdseed smap arat arch_capabilities        : spectre_v1 spec_store_bypass mds taa retbleed\nbogomips    : 4400.32 size    : 64    : 64 sizes    : 46 physical, 48 virtual management:\n
", "messages": [ { "id": 3246136, "postDate": "2025-07-10T12:02:17.577Z", "content": "

I seem to recall that in the past, Kaggle notebooks had 4 cores if you did not attach a GPU, 2 if you did.
\nNow, it seems like you only get 2 no matter the GPU status. A quick test with multiprocessing shows about 2x speed up with a pool=2 but no benefit to more than 2.

\n

/proc/cpuinfo shows 4 processors, each with 2 cores. Hmm

\n
!cat //cpuinfo =>    : 0    :\ncpu    : 6        : 79 name    : Xeon(R) @ 2.20GHz    : 0    : 0xffffffff MHz        : 2200.162 size    : 56320\nphysical    : 0    : 4 id        : 0 cores    : 2        : 0 apicid    : 0        :\nfpu_exception    :\ncpuid    : 13        :\nflags        : vme pse msr mce apic mtrr mca pat clflush fxsr sse2 ht nx rdtscp constant_tsc nopl nonstop_tsc tsc_known_freq pclmulqdq fma pcid sse4_2 movbe aes avx rdrand lahf_lm 3dnowprefetch ssbd ibpb fsgsbase bmi1 avx2 bmi2 invpcid rdseed smap arat arch_capabilities        : spectre_v1 spec_store_bypass mds taa retbleed\nbogomips    : 4400.32 size    : 64    : 64 sizes    : 46 physical, 48 virtual management:    : 1    :\ncpu    : 6        : 79 name    : Xeon(R) @ 2.20GHz    : 0    : 0xffffffff MHz        : 2200.162 size    : 56320\nphysical    : 0    : 4 id        : 1 cores    : 2        : 2 apicid    : 2        :\nfpu_exception    :\ncpuid    : 13        :\nflags        : vme pse msr mce apic mtrr mca pat clflush fxsr sse2 ht nx rdtscp constant_tsc nopl nonstop_tsc tsc_known_freq pclmulqdq fma pcid sse4_2 movbe aes avx rdrand lahf_lm 3dnowprefetch ssbd ibpb fsgsbase bmi1 avx2 bmi2 invpcid rdseed smap arat arch_capabilities        : spectre_v1 spec_store_bypass mds taa retbleed\nbogomips    : 4400.32 size    : 64    : 64 sizes    : 46 physical, 48 virtual management:    : 2    :\ncpu    : 6        : 79 name    : Xeon(R) @ 2.20GHz    : 0    : 0xffffffff MHz        : 2200.162 size    : 56320\nphysical    : 0    : 4 id        : 0 cores    : 2        : 1 apicid    : 1        :\nfpu_exception    :\ncpuid    : 13        :\nflags        : vme pse msr mce apic mtrr mca pat clflush fxsr sse2 ht nx rdtscp constant_tsc nopl nonstop_tsc tsc_known_freq pclmulqdq fma pcid sse4_2 movbe aes avx rdrand lahf_lm 3dnowprefetch ssbd ibpb fsgsbase bmi1 avx2 bmi2 invpcid rdseed smap arat arch_capabilities        : spectre_v1 spec_store_bypass mds taa retbleed\nbogomips    : 4400.32 size    : 64    : 64 sizes    : 46 physical, 48 virtual management:    : 3    :\ncpu    : 6        : 79 name    : Xeon(R) @ 2.20GHz    : 0    : 0xffffffff MHz        : 2200.162 size    : 56320\nphysical    : 0    : 4 id        : 1 cores    : 2        : 3 apicid    : 3        :\nfpu_exception    :\ncpuid    : 13        :\nflags        : vme pse msr mce apic mtrr mca pat clflush fxsr sse2 ht nx rdtscp constant_tsc nopl nonstop_tsc tsc_known_freq pclmulqdq fma pcid sse4_2 movbe aes avx rdrand lahf_lm 3dnowprefetch ssbd ibpb fsgsbase bmi1 avx2 bmi2 invpcid rdseed smap arat arch_capabilities        : spectre_v1 spec_store_bypass mds taa retbleed\nbogomips    : 4400.32 size    : 64    : 64 sizes    : 46 physical, 48 virtual management:\n
", "rawMarkdown": "I seem to recall that in the past, Kaggle notebooks had 4 cores if you did not attach a GPU, 2 if you did.\nNow, it seems like you only get 2 no matter the GPU status. A quick test with multiprocessing shows about 2x speed up with a pool=2 but no benefit to more than 2.\n\n/proc/cpuinfo shows 4 processors, each with 2 cores. Hmm\n```\n!cat /proc/cpuinfo =>\nprocessor\t: 0\nvendor_id\t: GenuineIntel\ncpu family\t: 6\nmodel\t\t: 79\nmodel name\t: Intel(R) Xeon(R) CPU @ 2.20GHz\nstepping\t: 0\nmicrocode\t: 0xffffffff\ncpu MHz\t\t: 2200.162\ncache size\t: 56320 KB\nphysical id\t: 0\nsiblings\t: 4\ncore id\t\t: 0\ncpu cores\t: 2\napicid\t\t: 0\ninitial apicid\t: 0\nfpu\t\t: yes\nfpu_exception\t: yes\ncpuid level\t: 13\nwp\t\t: yes\nflags\t\t: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc rep_good nopl xtopology nonstop_tsc cpuid tsc_known_freq pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 x2apic movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch pti ssbd ibrs ibpb stibp fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm rdseed adx smap xsaveopt arat md_clear arch_capabilities\nbugs\t\t: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa mmio_stale_data retbleed bhi\nbogomips\t: 4400.32\nclflush size\t: 64\ncache_alignment\t: 64\naddress sizes\t: 46 bits physical, 48 bits virtual\npower management:\n\nprocessor\t: 1\nvendor_id\t: GenuineIntel\ncpu family\t: 6\nmodel\t\t: 79\nmodel name\t: Intel(R) Xeon(R) CPU @ 2.20GHz\nstepping\t: 0\nmicrocode\t: 0xffffffff\ncpu MHz\t\t: 2200.162\ncache size\t: 56320 KB\nphysical id\t: 0\nsiblings\t: 4\ncore id\t\t: 1\ncpu cores\t: 2\napicid\t\t: 2\ninitial apicid\t: 2\nfpu\t\t: yes\nfpu_exception\t: yes\ncpuid level\t: 13\nwp\t\t: yes\nflags\t\t: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc rep_good nopl xtopology nonstop_tsc cpuid tsc_known_freq pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 x2apic movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch pti ssbd ibrs ibpb stibp fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm rdseed adx smap xsaveopt arat md_clear arch_capabilities\nbugs\t\t: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa mmio_stale_data retbleed bhi\nbogomips\t: 4400.32\nclflush size\t: 64\ncache_alignment\t: 64\naddress sizes\t: 46 bits physical, 48 bits virtual\npower management:\n\nprocessor\t: 2\nvendor_id\t: GenuineIntel\ncpu family\t: 6\nmodel\t\t: 79\nmodel name\t: Intel(R) Xeon(R) CPU @ 2.20GHz\nstepping\t: 0\nmicrocode\t: 0xffffffff\ncpu MHz\t\t: 2200.162\ncache size\t: 56320 KB\nphysical id\t: 0\nsiblings\t: 4\ncore id\t\t: 0\ncpu cores\t: 2\napicid\t\t: 1\ninitial apicid\t: 1\nfpu\t\t: yes\nfpu_exception\t: yes\ncpuid level\t: 13\nwp\t\t: yes\nflags\t\t: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc rep_good nopl xtopology nonstop_tsc cpuid tsc_known_freq pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 x2apic movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch pti ssbd ibrs ibpb stibp fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm rdseed adx smap xsaveopt arat md_clear arch_capabilities\nbugs\t\t: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa mmio_stale_data retbleed bhi\nbogomips\t: 4400.32\nclflush size\t: 64\ncache_alignment\t: 64\naddress sizes\t: 46 bits physical, 48 bits virtual\npower management:\n\nprocessor\t: 3\nvendor_id\t: GenuineIntel\ncpu family\t: 6\nmodel\t\t: 79\nmodel name\t: Intel(R) Xeon(R) CPU @ 2.20GHz\nstepping\t: 0\nmicrocode\t: 0xffffffff\ncpu MHz\t\t: 2200.162\ncache size\t: 56320 KB\nphysical id\t: 0\nsiblings\t: 4\ncore id\t\t: 1\ncpu cores\t: 2\napicid\t\t: 3\ninitial apicid\t: 3\nfpu\t\t: yes\nfpu_exception\t: yes\ncpuid level\t: 13\nwp\t\t: yes\nflags\t\t: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc rep_good nopl xtopology nonstop_tsc cpuid tsc_known_freq pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 x2apic movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch pti ssbd ibrs ibpb stibp fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm rdseed adx smap xsaveopt arat md_clear arch_capabilities\nbugs\t\t: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa mmio_stale_data retbleed bhi\nbogomips\t: 4400.32\nclflush size\t: 64\ncache_alignment\t: 64\naddress sizes\t: 46 bits physical, 48 bits virtual\npower management:\n```", "votes": 2 }, { "id": 3248471, "postDate": "2025-07-14T16:41:15.313Z", "rawMarkdown": "", "isDeleted": true } ], "comments": [ { "id": 3248471, "author_name": "", "author_url": "", "post_date": "2025-07-14T16:41:15.313000", "content": "", "votes": 0, "replies": [] } ], "raw_markdown_by_id": { "3246136": "I seem to recall that in the past, Kaggle notebooks had 4 cores if you did not attach a GPU, 2 if you did.\nNow, it seems like you only get 2 no matter the GPU status. A quick test with multiprocessing shows about 2x speed up with a pool=2 but no benefit to more than 2.\n\n/proc/cpuinfo shows 4 processors, each with 2 cores. Hmm\n```\n!cat /proc/cpuinfo =>\nprocessor\t: 0\nvendor_id\t: GenuineIntel\ncpu family\t: 6\nmodel\t\t: 79\nmodel name\t: Intel(R) Xeon(R) CPU @ 2.20GHz\nstepping\t: 0\nmicrocode\t: 0xffffffff\ncpu MHz\t\t: 2200.162\ncache size\t: 56320 KB\nphysical id\t: 0\nsiblings\t: 4\ncore id\t\t: 0\ncpu cores\t: 2\napicid\t\t: 0\ninitial apicid\t: 0\nfpu\t\t: yes\nfpu_exception\t: yes\ncpuid level\t: 13\nwp\t\t: yes\nflags\t\t: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc rep_good nopl xtopology nonstop_tsc cpuid tsc_known_freq pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 x2apic movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch pti ssbd ibrs ibpb stibp fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm rdseed adx smap xsaveopt arat md_clear arch_capabilities\nbugs\t\t: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa mmio_stale_data retbleed bhi\nbogomips\t: 4400.32\nclflush size\t: 64\ncache_alignment\t: 64\naddress sizes\t: 46 bits physical, 48 bits virtual\npower management:\n\nprocessor\t: 1\nvendor_id\t: GenuineIntel\ncpu family\t: 6\nmodel\t\t: 79\nmodel name\t: Intel(R) Xeon(R) CPU @ 2.20GHz\nstepping\t: 0\nmicrocode\t: 0xffffffff\ncpu MHz\t\t: 2200.162\ncache size\t: 56320 KB\nphysical id\t: 0\nsiblings\t: 4\ncore id\t\t: 1\ncpu cores\t: 2\napicid\t\t: 2\ninitial apicid\t: 2\nfpu\t\t: yes\nfpu_exception\t: yes\ncpuid level\t: 13\nwp\t\t: yes\nflags\t\t: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc rep_good nopl xtopology nonstop_tsc cpuid tsc_known_freq pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 x2apic movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch pti ssbd ibrs ibpb stibp fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm rdseed adx smap xsaveopt arat md_clear arch_capabilities\nbugs\t\t: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa mmio_stale_data retbleed bhi\nbogomips\t: 4400.32\nclflush size\t: 64\ncache_alignment\t: 64\naddress sizes\t: 46 bits physical, 48 bits virtual\npower management:\n\nprocessor\t: 2\nvendor_id\t: GenuineIntel\ncpu family\t: 6\nmodel\t\t: 79\nmodel name\t: Intel(R) Xeon(R) CPU @ 2.20GHz\nstepping\t: 0\nmicrocode\t: 0xffffffff\ncpu MHz\t\t: 2200.162\ncache size\t: 56320 KB\nphysical id\t: 0\nsiblings\t: 4\ncore id\t\t: 0\ncpu cores\t: 2\napicid\t\t: 1\ninitial apicid\t: 1\nfpu\t\t: yes\nfpu_exception\t: yes\ncpuid level\t: 13\nwp\t\t: yes\nflags\t\t: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc rep_good nopl xtopology nonstop_tsc cpuid tsc_known_freq pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 x2apic movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch pti ssbd ibrs ibpb stibp fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm rdseed adx smap xsaveopt arat md_clear arch_capabilities\nbugs\t\t: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa mmio_stale_data retbleed bhi\nbogomips\t: 4400.32\nclflush size\t: 64\ncache_alignment\t: 64\naddress sizes\t: 46 bits physical, 48 bits virtual\npower management:\n\nprocessor\t: 3\nvendor_id\t: GenuineIntel\ncpu family\t: 6\nmodel\t\t: 79\nmodel name\t: Intel(R) Xeon(R) CPU @ 2.20GHz\nstepping\t: 0\nmicrocode\t: 0xffffffff\ncpu MHz\t\t: 2200.162\ncache size\t: 56320 KB\nphysical id\t: 0\nsiblings\t: 4\ncore id\t\t: 1\ncpu cores\t: 2\napicid\t\t: 3\ninitial apicid\t: 3\nfpu\t\t: yes\nfpu_exception\t: yes\ncpuid level\t: 13\nwp\t\t: yes\nflags\t\t: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc rep_good nopl xtopology nonstop_tsc cpuid tsc_known_freq pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 x2apic movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch pti ssbd ibrs ibpb stibp fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm rdseed adx smap xsaveopt arat md_clear arch_capabilities\nbugs\t\t: cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds swapgs taa mmio_stale_data retbleed bhi\nbogomips\t: 4400.32\nclflush size\t: 64\ncache_alignment\t: 64\naddress sizes\t: 46 bits physical, 48 bits virtual\npower management:\n```", "3248471": "" } }