Custom Repository Configuration Guide ​

Background ​

• Supports using custom repository configuration, supports custom configuration of image repository, binary repository, and chart repository.
• Supports one-way authentication access for image repository and chart repository (containerd and helm one-way access to repository, using the same CA). Binary repository does not involve authentication access.

Note:
Currently only the numa component uses chart repository independently in addon.

Prerequisites ​

• Users need to provide custom image repository, binary repository, and chart repository.

  • Please import all required images into the private image repository (pay attention to correct namespace, image name, and image tag).
  • Import all required binary files into the private binary repository.
  • Import all required chart packages into the private chart repository.

• On the bootstrap node, upload the repository root CA to the specified path /etc/openFuyao according to the convention, with ca.crt file permission 644. The directory structure is /etc/openFuyao/ca.crt.

• For a list of media to be uploaded, see the Appendix.

Restrictions ​

None.

Procedure ​

1. Bootstrap node initialization.

   Upload the bkeadm binary tool to the bootstrap node Use bke init to complete bootstrap node initialization. Below is an initialization command reference:

   
     bke init \
     # 1. Image repository
     --otherRepo 192.168.100.17:443/openfuyao \   # Custom image repository (including port + path), namespace recommended to be openFuyao
     --domain my.harbor.com \                     # Image repository domain name (matched with --otherRepo to ensure certificate and access consistency)
     --imageRepoPort 443 \                        # Image repository port (explicitly specify port number)
     --imageRepoCAFile /etc/openFuyao/ca.crt \    # Private repository CA certificate (specify certificate path to read)
     # 2. Binary repository
     --otherSource http://192.168.100.48:8080 \   
     # 3. Function switches: disable console installation
     --installConsole=false \                     # Do not install BKE built-in console (disabled by default)
     --enableNTP=false \                          # Do not perform NTP synchronization service operations
     # 4. Other
     --confirm                                    # Pre-confirm, no need for subsequent Y/N confirmation

2. Create management cluster/business cluster through bc.

   Edit bc, modify to custom image repository and binary repository. Chart repository is modified in addon parameters.

   yaml

   httpRepo:  #http repository
           domain: http.bocloud.k8s   #No need to modify
           ip: 192.168.200.173      #Modify to actual http repository ip
           port: "40080"            #Modify to actual http repository port number
           prefix: ""               #Default is empty
         imageRepo:  #image repository
           domain: deploy.bocloud.k8s      #Modify to actual image repository domain
           ip: 192.168.200.173     #Modify to actual image repository ip
           port: "40443"           #Modify to actual image repository port number
           prefix: openfuyao       #Modify to actual project name

   Also edit cct, add containerd configuration

   yaml

   registry:
       configPath: /etc/containerd/certs.d
       configs:  
         "my.harbor.com":            #Image repository domain
           capabilities: ["pull", "resolve"] 
           host: my.harbor.com           
           skipVerify: false                 
           plainHTTP: false                 
           tls:                             
             caFile: /etc/openFuyao/ca.crt  
             insecureSkipVerify: false

   If you need to install the NUMA affinity plugin during bke cluster installation, you need to modify addon parameters in bke-cluster cr, example as follows:

   yaml

   name: numa-affinity-package
     param:
       openfuyaoRepo: https://private chart repository address
       version: v0.0.2

Appendix ​

Image List ​

1. Basic components for building K3s cluster, architectures are all amd64、arm64.

2. K8s core component images (needDownload: true)

Covers K8s control plane, network, load balancing and other core functions, architectures are all amd64、arm64.

3. bke tool itself

4. Extension components

4.1 Volcano scheduling extension

Architectures are all amd64、arm64, used for container scheduling optimization (such as NUMA affinity, resource scheduling).

Binary File List ​

1. K8s core operation tools

Used for K8s cluster command line management and node operation, all provide amd64/arm64 dual architecture support.

2. Container runtime core components

Supporting container start/stop and resource management underlying binaries, containing runtime main body and core dependencies.

3. Container Network Interface (CNI)

Used to configure container network (such as network isolation, cross-node communication), archive format (contains multiple CNI plugin binaries).

4. Package management and configuration processing tools

Used for Helm Chart management, YAML/JSON parsing and other operation tasks.

5. Auxiliary archives for RPM package management and NFS shared configuration (contains related binaries or scripts).

6. BKE cluster specific management tools

openFuyao BKE cluster initialization and operation tools, dual architecture support.

Note: The cfssl tool is used in openFuyao core components and is not used in co-creation scenarios.

Complete Binary File List

files:
  - address: https://openfuyao.obs.cn-north-4.myhuaweicloud.com/kubernetes/kubernetes/releases/download/of-v1.33.1/bin/linux/arm64/
    files:
      - kubectl-v1.33.1-arm64
  - address: https://openfuyao.obs.cn-north-4.myhuaweicloud.com/kubernetes/kubernetes/releases/download/of-v1.33.1/bin/linux/amd64/
    files:
      - kubectl-v1.33.1-amd64
  - address: https://openfuyao.obs.cn-north-4.myhuaweicloud.com/kubernetes/kubernetes/releases/download/of-v1.33.1/bin/linux/arm64/
    files:
      - kubelet-v1.33.1-arm64
  - address: https://openfuyao.obs.cn-north-4.myhuaweicloud.com/kubernetes/kubernetes/releases/download/of-v1.33.1/bin/linux/amd64/
    files:
      - kubelet-v1.33.1-amd64
  - address: https://openfuyao.obs.cn-north-4.myhuaweicloud.com/containerd/containerd/releases/download/v2.1.1-origin/
    files:
      - containerd-v2.1.1-linux-amd64.tar.gz
      - containerd-v2.1.1-linux-arm64.tar.gz
  - address: https://openfuyao.obs.cn-north-4.myhuaweicloud.com/containernetworking/plugins/releases/download/v1.4.1/
    files:
      - cni-plugins-linux-amd64-v1.4.1.tgz
      - cni-plugins-linux-arm64-v1.4.1.tgz
  - address: https://openfuyao.obs.cn-north-4.myhuaweicloud.com/helm/releases/download/v3.14.2/
    files:
      - helm-v3.14.2-linux-amd64.tar.gz
      - helm-v3.14.2-linux-arm64.tar.gz
  - address: https://openfuyao.obs.cn-north-4.myhuaweicloud.com/mikefarah/yq/releases/download/v4.43.1
    files:
      - yq_linux_arm64
      - yq_linux_amd64
  - address: https://openfuyao.obs.cn-north-4.myhuaweicloud.com/jqlang/jq/releases/download/v1.7.1
    files:
      - jq-linux-arm64
      - jq-linux-amd64
  - address: https://openfuyao.obs.cn-north-4.myhuaweicloud.com/cloudflare/cfssl/releases/download/v1.6.4
    files:
      - cfssl-certinfo_1.6.4_linux_arm64
      - cfssl-certinfo_1.6.4_linux_amd64
      - cfssl_1.6.4_linux_arm64
      - cfssl_1.6.4_linux_amd64
      - cfssljson_1.6.4_linux_arm64
      - cfssljson_1.6.4_linux_amd64
  - address: https://openfuyao.obs.cn-north-4.myhuaweicloud.com/opencontainers/runc/releases/download/v1.1.12/
    files:
      - runc-arm64
      - runc-amd64
  - address: https://openfuyao.obs.cn-north-4.myhuaweicloud.com/etcd-io/etcd/releases/download/v3.5.6/
    files:
      - etcdctl-v3.5.6-linux-amd64
      - etcdctl-v3.5.6-linux-arm64
  - address: https://openfuyao.obs.cn-north-4.myhuaweicloud.com/rpm/releases/download/v0.0.1/
    files:
      - rpm.tar.gz
  - address: https://openfuyao.obs.cn-north-4.myhuaweicloud.com/nfs/
    files:
      - nfsshare.tar.gz
  - address: https://openfuyao.obs.cn-north-4.myhuaweicloud.com/charts/releases/download/latest/
    files:
      - charts.tar.gz
  - address: https://openfuyao.obs.cn-north-4.myhuaweicloud.com/openFuyao/bkeadm/releases/download/latest/
    files:
      - bkeadm_linux_amd64
      - bkeadm_linux_arm64

chart Package List ​

Currently only involves the NUMA component.

  - address: https://openfuyao.obs.cn-north-4.myhuaweicloud.com/charts/releases/download/latest/
    files:
      - numa-affinity-package-0.0.0-latest.tgz