installation failing on arm

[Hritik14]

make dev
...

ERROR: Cannot install extractcode[full]==31.0.0 because these package versions have conflicting dependencies.

The conflict is caused by:
    extractcode[full] 31.0.0 depends on extractcode-7z>=16.5.210525; extra == "full"
    The user requested (constraint) extractcode-7z==16.5.210531

Additionally, some packages in these conflicts have no matching distributions available for your environment:
    extractcode-7z

[keshav-space]

@Hritik14 can you share which os, architecture, and python version you’re running?

[Hritik14]

@keshav-space

Linux minecraft 6.8.0-1026-oracle #27-Ubuntu SMP Thu Apr 24 21:41:08 UTC 2025 aarch64 aarch64 aarch64 GNU/Linux
Python 3.12.3

[Hritik14]

shouldn't be an os issue imo, could be an arch issue though. regardless, i've opened a PR. do have a look

[keshav-space]

yes, this is an arch issue. Dev install works on x86_64 with python 3.12.3

[Hritik14]

ah, this is the 2nd time I've stumbled upon this

aboutcode-org/scancode.io#866

[Hritik14]

sadly extractcode-7z doesn't offer arm wheels, it is causing both these errors.
https://pypi.org/project/extractcode-7z/#files

[Hritik14]

Weird that older extractcode had arm and x86 builds but newer only has x86...
https://pypi.org/project/extractcode-7z/16.5.210525/#files

[Hritik14]

Related: aboutcode-org/extractcode#73

[AyanSinhaMahapatra]

We're working on arm support everywhere, see for example

• https://github.com/aboutcode-org/typecode/pull/40/changes
• https://github.com/AyanSinhaMahapatra/scancode-toolkit/actions/workflows/scancode-release.yml
• Publish licensedcode data/index as seperate pypi wheels and improve arm installation support scancode-toolkit#4847

This is using system provided extraction/type checking libraries instead of bundled ones.

Then instead of extractcode[full] we would have an extractcode[system_provided] option which should support arm allright.
Currently testing arm support for scancode first, and this should propagate soon to all repos.
Let me see if this is already possible in vulnerablecode with a few changes.

The limiting issue here was CI, but with https://github.blog/changelog/2025-01-16-linux-arm64-hosted-runners-now-available-for-free-in-public-repositories-public-preview/ and later now this is available as github actions and this greatly helps releasing required wheels and testing support on arm.

[AyanSinhaMahapatra]

Weird that older extractcode had arm and x86 builds but newer only has x86...

These are dummy/empty wheels, see the upload dates for arm wheels, uploaded recently ;)
Just a weird solution for compatibility issues, we are still testing all the cases here.

[Hritik14]

thanks @AyanSinhaMahapatra

Meanwhile, to install vulnerablecode with the dummy wheels, I've applied the following patch

--- a/requirements-dev.txt
+++ b/requirements-dev.txt
@@ -42,8 +42,6 @@ drf-spectacular==0.24.2
 drf-spectacular-sidecar==2022.10.1
 executing==2.2.1
 extractcode==31.0.0
-extractcode-7z==16.5.210531
-extractcode-libarchive==3.5.1.210531
 fetchcode==0.8.2
 flot==0.7.3
 freezegun==1.2.1
@@ -150,7 +148,6 @@ tomli==2.4.0
 traitlets==5.14.3
 twine==6.2.0
 typecode==30.2.0
-typecode-libmagic==5.39.210531
 typing_extensions==4.13.0
 tzlocal==5.3.1
 univers==30.12.0

Essentially unpinning extractcode so that it falls back on extractcode-7z==16.5.210525.
This is potentially breaking (but helpful if someone is interested)

[AyanSinhaMahapatra]

Try also typecode-libmagic[system_provided]

[Hritik14]

Probably not rolled out in the version I have here (latest arm version):

typecode-libmagic 5.39.210223 does not provide the extra 'system-provided'

& there's no arm build for 5.39.210531 anyway