tokenizers [building on windows] onig_sys/oniguruma two or more data types in declaration specifiers

sycxhyv7  于 22天前  发布在  Windows
关注(0)|答案(2)|浏览(27)

我正在使用tokenizerscandle,我的一个Windows用户在尝试构建screenpipe时遇到了两个问题:

CPU only

PS D:\AI\Screen\screen-pipe> cargo build --release
   Compiling rustls-webpki v0.102.6
   Compiling onig_sys v69.8.1
   Compiling symphonia-utils-xiph v0.5.4
   Compiling hyper-tls v0.5.0
   Compiling http-body v1.0.1
   Compiling spm_precompiled v0.1.4
   Compiling idna v0.5.0
   Compiling tokio v1.39.2
   Compiling indexmap v1.9.3
   Compiling macro_rules_attribute v0.2.0
   Compiling ntapi v0.4.1
   Compiling which v6.0.1
   Compiling windows v0.54.0
   Compiling digest v0.10.7
   Compiling rayon-cond v0.3.0
   Compiling parking_lot v0.12.3
   Compiling fancy-regex v0.13.0
   Compiling zune-jpeg v0.4.13
   Compiling candle-nn v0.6.0
   Compiling tiff v0.9.1
   Compiling regex v1.10.5
   Compiling crossbeam-utils v0.8.20
   Compiling derive_builder v0.20.0
   Compiling esaxx-rs v0.1.10
   Compiling futures v0.3.30
   Compiling tokio-stream v0.1.15
   Compiling serde_plain v1.0.2
   Compiling qoi v0.4.1
   Compiling schannel v0.1.23
   Compiling axum-core v0.3.4
   Compiling cexpr v0.6.0
   Compiling serde_json v1.0.121
   Compiling tracing-core v0.1.32
   Compiling native-tls v0.2.12
   Compiling unicode-normalization-alignments v0.1.12
   Compiling thiserror v1.0.63
   Compiling reqwest v0.11.27
   Compiling bitflags v2.6.0
   Compiling heck v0.5.0
   Compiling fastrand v2.1.0
   Compiling itoa v1.0.11
   Compiling unicode_categories v0.1.1
   Compiling log v0.4.22
   Compiling lazy_static v1.5.0
   Compiling shlex v1.3.0
   Compiling cpufeatures v0.2.12
   Compiling strsim v0.11.1
   Compiling clap_lex v0.7.2
   Compiling rustc-hash v1.1.0
   Compiling ryu v1.0.18
   Compiling crc-catalog v2.4.0
   Compiling lazycell v1.3.0
   Compiling crossbeam-queue v0.3.11
   Compiling url v2.5.2
   Compiling clap_derive v4.5.11
   Compiling sha2 v0.10.8
The following warnings were emitted during compilation:

warning: onig_sys@69.8.1: In file included from oniguruma\src/regenc.h:36,
warning: onig_sys@69.8.1:                  from oniguruma\src/regint.h:103,
warning: onig_sys@69.8.1:                  from oniguruma\src\regexec.c:36:
warning: onig_sys@69.8.1: D:\AI\Screen\screen-pipe\target\release\build\onig_sys-308529629068d6af\out/config.h:32:15: error: two or more data types in declaration specifiers
warning: onig_sys@69.8.1:    32 | #define uid_t int
warning: onig_sys@69.8.1:       |               ^~~
warning: onig_sys@69.8.1: D:\AI\Screen\screen-pipe\target\release\build\onig_sys-308529629068d6af\out/config.h:33:15: error: two or more data types in declaration specifiers
warning: onig_sys@69.8.1:    33 | #define gid_t int
warning: onig_sys@69.8.1:       |               ^~~

error: failed to run custom build command for `onig_sys v69.8.1`

Caused by:
  process didn't exit successfully: `D:\AI\Screen\screen-pipe\target\release\build\onig_sys-d764c792d708edb0\build-script-build` (exit code: 1)
  --- stdout
  cargo:rerun-if-env-changed=RUSTONIG_DYNAMIC_LIBONIG
  cargo:rerun-if-env-changed=RUSTONIG_STATIC_LIBONIG
  cargo:rerun-if-env-changed=RUSTONIG_SYSTEM_LIBONIG
  OUT_DIR = Some(D:\AI\Screen\screen-pipe\target\release\build\onig_sys-308529629068d6af\out)
  TARGET = Some(x86_64-pc-windows-gnu)
  OPT_LEVEL = Some(3)
  HOST = Some(x86_64-pc-windows-gnu)
  cargo:rerun-if-env-changed=CC_x86_64-pc-windows-gnu
  CC_x86_64-pc-windows-gnu = None
  cargo:rerun-if-env-changed=CC_x86_64_pc_windows_gnu
  CC_x86_64_pc_windows_gnu = None
  cargo:rerun-if-env-changed=HOST_CC
  HOST_CC = None
  cargo:rerun-if-env-changed=CC
  CC = None
  cargo:rerun-if-env-changed=CC_ENABLE_DEBUG_OUTPUT
  RUSTC_WRAPPER = None
  cargo:rerun-if-env-changed=CRATE_CC_NO_DEFAULTS
  CRATE_CC_NO_DEFAULTS = None
  DEBUG = Some(false)
  CARGO_CFG_TARGET_FEATURE = Some(cmpxchg16b,fxsr,sse,sse2,sse3)
  cargo:rerun-if-env-changed=CFLAGS_x86_64-pc-windows-gnu
  CFLAGS_x86_64-pc-windows-gnu = None
  cargo:rerun-if-env-changed=CFLAGS_x86_64_pc_windows_gnu
  CFLAGS_x86_64_pc_windows_gnu = None
  cargo:rerun-if-env-changed=HOST_CFLAGS
  HOST_CFLAGS = None
  cargo:rerun-if-env-changed=CFLAGS
  CFLAGS = None
  cargo:warning=In file included from oniguruma\src/regenc.h:36,
  cargo:warning=                 from oniguruma\src/regint.h:103,
  cargo:warning=                 from oniguruma\src\regexec.c:36:
  cargo:warning=D:\AI\Screen\screen-pipe\target\release\build\onig_sys-308529629068d6af\out/config.h:32:15: error: two or more data types in declaration specifiers
  cargo:warning=   32 | #define uid_t int
  cargo:warning=      |               ^~~
  cargo:warning=D:\AI\Screen\screen-pipe\target\release\build\onig_sys-308529629068d6af\out/config.h:33:15: error: two or more data types in declaration specifiers
  cargo:warning=   33 | #define gid_t int
  cargo:warning=      |               ^~~

  --- stderr

  error occurred: Command "gcc.exe" "-O3" "-ffunction-sections" "-fdata-sections" "-m64" "-I" "D:\\AI\\Screen\\screen-pipe\\target\\release\\build\\onig_sys-308529629068d6af\\out" "-I" "oniguruma\\src" "-o" "D:\\AI\\Screen\\screen-pipe\\target\\release\\build\\onig_sys-308529629068d6af\\out\\abd886268342579b-regexec.o" "-c" "oniguruma\\src\\regexec.c" with args gcc.exe did not execute successfully (status code exit code: 1).

warning: build failed, waiting for other jobs to finish...
    Building [=================>       ] 446/606: windows

cuda

huggingface/candle#353
他只是想让至少在CPU上正常工作,尝试在Windows上禁用onig,因为似乎你的Cargo.toml中有optional,但然后构建器抱怨没有onig
如何在windows上构建分词器?

7dl7o3gd

7dl7o3gd1#

你还可以使用unstable_wasm来使用高级正则表达式。

atmip9wb

atmip9wb2#

你是对的,它原本应该是可选的😓现在不是了。

相关问题