AnSwErYWJ's Blog

Git仓库过大导致clone失败的解决方法

字数统计: 543阅读时长: 12 min
2019/09/09

本文记录工作中遇到的clone大仓库失败的解决过程,以下问题与解决方案均基于https访问。

错误一

web端查看仓库大小,大约1.5G左右,首先直接执行git clone,报错如下:

1
2
3
4
5
6
remote: Counting objects: 10994, done.
remote: Compressing objects: 100% (3085/3085), done.
error: RPC failed; curl 56 GnuTLS recv error (-110): The TLS connection was non-properly terminated.
fatal: The remote end hung up unexpectedly
fatal: early EOF
fatal: index-pack failed

增大postBuffer

在增大postBuffer的同时,关闭ssl认证:

1
2
$ git config --global http.postBuffer 2048000000 # 设置为2G
$ git config --global http.sslVerify false # 关闭sslVerify

设置成功后,重新clone,错误依旧。

使用openssl替换gunssl

1.安装相关依赖环境:

1
$ sudo apt-get install build-essential fakeroot dpkg-dev libcurl4-openssl-dev

2.获取git源码:

1
$ sudo apt-get source git

若出现如下错误:

1
E: You must put some 'source' URIs in your sources.list

则需要将设置->Software & Updates->Ubuntu Software->Source code勾选:
source_code

若出现如下错误:

1
couldn't be accessed by user '_apt'. - pkgAcquire::Run (13: Permission denied) [duplicate]

则需要更改权限:

1
sudo chown _apt /var/lib/update-notifier/package-data-downloads/partial/

3.安装git的依赖

1
$ sudo apt-get build-dep git

4.进入git目录,重新编译:

1
2
3
4
$ cd git-2.7.4/
$ vim ./debian/control # 将libcurl4-gnutls-dev修改为libcurl4-openssl-dev
$ vim ./debian/rules # 整行删除TEST=test
$ sudo dpkg-buildpackage -rfakeroot -b -uc -us -j4 # 编译

5.回到上一级目录,安装编译好的安装包:

1
2
$ cd ..
$ sudo dpkg -i git_2.7.4-0ubuntuxxx_amd64.deb # 安装包名字可能有所不同

执行完成如上步骤后,重新clone,发现依旧报错,请看错误二。

错误二

1
2
3
4
5
6
remote: Counting objects: 10994, done.
remote: Compressing objects: 100% (3085/3085), done.
error: RPC failed; curl 18 transfer closed with outstanding read data remaining
fatal: The remote end hung up unexpectedly
fatal: early EOF
fatal: index-pack failed

重新确认postBuffer,配置确实生效了:

1
2
3
4
5
$ cat ~/.gitconfig

[http]
sslVerify = false
postBuffer = 2048000000

浅层clone

晕,实在搞不定了,采取极端方法,首先clone一层:

1
$ git clone --depth=1 http://xxx.git

浅层clone成功后,再完整拉取:

1
2
3
$ git fetch --unshallow # 拉取完整当前分支
$ git remote set-branches origin '*' # 追踪所有远程分支
$ git fetch -v # 拉取所有远程分支

至此,终于成功地clone了一个完整的仓库。

原文作者:AnSwErYWJ

原文链接:https://answerywj.com/2019/09/09/git-clone-extra-large-project/

发表日期:2019/09/09 12:09

版权声明:本文采用Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License进行许可.
Creative Commons License

CATALOG
  1. 1. 错误一
    1. 1.1. 增大postBuffer
    2. 1.2. 使用openssl替换gunssl
  2. 2. 错误二
    1. 2.1. 浅层clone