If your application is for developers, chances are good that it could benefit from integration with source control. Even non-developer applications, such as document editors, could potentially benefit from version-control features, and Git’s model works very well for many different scenarios.
If you need to integrate Git with your application, you have essentially three choices: spawning a shell and using the Git command-line tool; Libgit2; and JGit.
One option is to spawn a shell process and use the Git command-line tool to do the work. This has the benefit of being canonical, and all of Git’s features are supported. This also happens to be fairly easy, as most runtime environments have a relatively simple facility for invoking a process with command-line arguments. However, this approach does have some downsides.
One is that all the output is in plain text. This means that you’ll have to parse Git’s occasionally-changing output format to read progress and result information, which can be inefficient and error-prone.
Another is the lack of error recovery. If a repository is corrupted somehow, or the user has a malformed configuration value, Git will simply refuse to perform many operations.
Yet another is process management. Git requires you to maintain a shell environment on a separate process, which can add unwanted complexity. Trying to coordinate many of these processes (especially when potentially accessing the same repository from several processes) can be quite a challenge.
Another option at your disposal is to use Libgit2. Libgit2 is a dependency-free implementation of Git, with a focus on having a nice API for use within other programs. You can find it at http://libgit2.github.com.
First, let’s take a look at what the C API looks like. Here’s a whirlwind tour:
// Open a repository
git_repository
*
repo
;
int
error
=
git_repository_open
(
&
amp
;
repo
,
"/path/to/repository"
);
// Dereference HEAD to a commit
git_object
*
head_commit
;
error
=
git_revparse_single
(
&
amp
;
head_commit
,
repo
,
"HEAD^{commit}"
);
git_commit
*
commit
=
(
git_commit
*
)
head_commit
;
// Print some of the commit's properties
printf
(
"%s"
,
git_commit_message
(
commit
));
const
git_signature
*
author
=
git_commit_author
(
commit
);
printf
(
"%s <%s>
\n
"
,
author
-&
gt
;
name
,
author
-&
gt
;
);
const
git_oid
*
tree_id
=
git_commit_tree_id
(
commit
);
// Cleanup
git_commit_free
(
commit
);
git_repository_free
(
repo
);
The first couple of lines open a Git repository.
The git_repository
type represents a handle to a repository with a cache in memory.
This is the simplest method, for when you know the exact path to a repository’s working directory or .git
folder.
There’s also the git_repository_open_ext
which includes options for searching, git_clone
and friends for making a local clone of a remote repository, and git_repository_init
for creating an entirely new repository.
The second chunk of code uses rev-parse syntax (see Branch References for more on this) to get the commit that HEAD eventually points to.
The type returned is a git_object
pointer, which represents something that exists in the Git object database for a repository.
git_object
is actually a “parent” type for several different kinds of objects; the memory layout for each of the “child” types is the same as for git_object
, so you can safely cast to the right one.
In this case, git_object_type(commit)
would return GIT_OBJ_COMMIT
, so it’s safe to cast to a git_commit
pointer.
The next chunk shows how to access the commit’s properties.
The last line here uses a git_oid
type; this is Libgit2's representation for a SHA-1 hash.
From this sample, a couple of patterns have started to emerge:
If you declare a pointer and pass a reference to it into a Libgit2 call, that call will probably return an integer error code.
A 0
value indicates success; anything less is an error.
If Libgit2 populates a pointer for you, you’re responsible for freeing it.
If Libgit2 returns a const
pointer from a call, you don’t have to free it, but it will become invalid when the object it belongs to is freed.
Writing C is a bit painful.
That last one means it isn’t very probable that you’ll be writing C when using Libgit2. Fortunately, there are a number of language-specific bindings available that make it fairly easy to work with Git repositories from your specific language and environment. Let’s take a look at the above example written using the Ruby bindings for Libgit2, which are named Rugged, and can be found at https://github.com/libgit2/rugged.
repo
=
Rugged
:
:Repository
.
new
(
'path/to/repository'
)
commit
=
repo
.
head
.
target
puts
commit
.
message
puts
"
#{
commit
.
author
[
:name
]
}
<
#{
commit
.
author
[
]
}
>"
tree
=
commit
.
tree
As you can see, the code is much less cluttered.
Firstly, Rugged uses exceptions; it can raise things like ConfigError
or ObjectError
to signal error conditions.
Secondly, there’s no explicit freeing of resources, since Ruby is garbage-collected.
Let’s take a look at a slightly more complicated example: crafting a commit from scratch
blob_id
=
repo
.
write
(
"
Blob contents
"
,
:blob
)
index
=
repo
.
index
index
.
read_tree
(
repo
.
head
.
target
.
tree
)
index
.
add
(
:path
=
&
gt
;
'newfile.txt'
,
:oid
=
&
gt
;
blob_id
)
sig
=
{
=
&
gt
;
"
bob@example.com
"
,
:name
=
&
gt
;
"
Bob User
"
,
:time
=
&
gt
;
Time
.
now
,
}
commit_id
=
Rugged
:
:Commit
.
create
(
repo
,
:tree
=
&
gt
;
index
.
write_tree
(
repo
)
,
:author
=
&
gt
;
sig
,
:committer
=
&
gt
;
sig
,
:message
=
&
gt
;
"
Add newfile.txt
"
,
:parents
=
&
gt
;
repo
.
empty?
?
[
]
:
[
repo
.
head
.
target
]
.
compact
,
:update_ref
=
&
gt
;
'HEAD'
,
)
commit
=
repo
.
lookup
(
commit_id
)
Create a new blob, which contains the contents of a new file.
Populate the index with the head commit’s tree, and add the new file at the path newfile.txt
.
This creates a new tree in the ODB, and uses it for the new commit.
We use the same signature for both the author and committer fields.
The commit message.
When creating a commit, you have to specify the new commit’s parents. This uses the tip of HEAD for the single parent.
Rugged (and Libgit2) can optionally update a reference when making a commit.
The return value is the SHA-1 hash of a new commit object, which you can then use to get a Commit
object.
The Ruby code is nice and clean, but since Libgit2 is doing the heavy lifting, this code will run pretty fast, too. If you’re not a rubyist, we touch on some other bindings in Other Bindings.
Libgit2 has a couple of capabilities that are outside the scope of core Git. One example is pluggability: Libgit2 allows you to provide custom “backends” for several types of operation, so you can store things in a different way than stock Git does. Libgit2 allows custom backends for configuration, ref storage, and the object database, among other things.
Let’s take a look at how this works. The code below is borrowed from the set of backend examples provided by the Libgit2 team (which can be found at https://github.com/libgit2/libgit2-backends). Here’s how a custom backend for the object database is set up:
git_odb
*
odb
;
int
error
=
git_odb_new
(
&
amp
;
odb
)
;
git_odb_backend
*
my_backend
;
error
=
git_odb_backend_mine
(
&
amp
;
my_backend
,
/*…*/
)
;
error
=
git_odb_add_backend
(
odb
,
my_backend
,
1
)
;
git_repository
*
repo
;
error
=
git_repository_open
(
&
amp
;
repo
,
"
some-path
"
)
;
error
=
git_repository_set_odb
(
odb
)
;
(Note that errors are captured, but not handled. We hope your code is better than ours.)
Initialize an empty object database (ODB) “frontend,” which will act as a container for the “backends” which are the ones doing the real work.
Initialize a custom ODB backend.
Add the backend to the frontend.
Open a repository, and set it to use our ODB to look up objects.
But what is this git_odb_backend_mine
thing?
Well, that’s the constructor for your own ODB implementation, and you can do whatever you want in there, so long as you fill in the git_odb_backend
structure properly.
Here’s what it could look like:
typedef
struct
{
git_odb_backend
parent
;
// Some other stuff
void
*
custom_context
;
}
my_backend_struct
;
int
git_odb_backend_mine
(
git_odb_backend
**
backend_out
,
/*…*/
)
{
my_backend_struct
*
backend
;
backend
=
calloc
(
1
,
sizeof
(
my_backend_struct
));
backend
-&
gt
;
custom_context
=
…
;
backend
-&
gt
;
parent
.
read
=
&
amp
;
my_backend__read
;
backend
-&
gt
;
parent
.
read_prefix
=
&
amp
;
my_backend__read_prefix
;
backend
-&
gt
;
parent
.
read_header
=
&
amp
;
my_backend__read_header
;
// …
*
backend_out
=
(
git_odb_backend
*
)
backend
;
return
GIT_SUCCESS
;
}
The subtlest constraint here is that my_backend_struct
's first member must be a git_odb_backend
structure; this ensures that the memory layout is what the Libgit2 code expects it to be.
The rest of it is arbitrary; this structure can be as large or small as you need it to be.
The initialization function allocates some memory for the structure, sets up the custom context, and then fills in the members of the parent
structure that it supports.
Take a look at the include/git2/sys/odb_backend.h
file in the Libgit2 source for a complete set of call signatures; your particular use case will help determine which of these you’ll want to support.
Libgit2 has bindings for many languages.
Here we show a small example using a few of the more complete bindings packages as of this writing; libraries exist for many other languages, including C++, Go, Node.js, Erlang, and the JVM, all in various stages of maturity.
The official collection of bindings can be found by browsing the repositories at https://github.com/libgit2.
The code we’ll write will return the commit message from the commit eventually pointed to by HEAD (sort of like git log -1
).
If you’re writing a .NET or Mono application, LibGit2Sharp (https://github.com/libgit2/libgit2sharp) is what you’re looking for. The bindings are written in C#, and great care has been taken to wrap the raw Libgit2 calls with native-feeling CLR APIs. Here’s what our example program looks like:
new
Repository
(
@"C:\path\to\repo"
).
Head
.
Tip
.
Message
;
For desktop Windows applications, there’s even a NuGet package that will help you get started quickly.
If your application is running on an Apple platform, you’re likely using Objective-C as your implementation language. Objective-Git (https://github.com/libgit2/objective-git) is the name of the Libgit2 bindings for that environment. The example program looks like this:
GTRepository
*
repo
=
[[
GTRepository
alloc
]
initWithURL
:[
NSURL
fileURLWithPath
:
@"/path/to/repo"
]
error
:
NULL
];
NSString
*
msg
=
[[[
repo
headReferenceWithError
:
NULL
]
resolvedTarget
]
message
];
Objective-git is fully interoperable with Swift, so don’t fear if you’ve left Objective-C behind.
The bindings for Libgit2 in Python are called Pygit2, and can be found at http://www.pygit2.org/. Our example program:
pygit2
.
Repository
(
"/path/to/repo"
)
# open repository
.
head
# get the current branch
.
peel
(
pygit2
.
Commit
)
# walk down to the commit
.
message
# read the message
Of course, a full treatment of Libgit2's capabilities is outside the scope of this book. If you want more information on Libgit2 itself, there’s API documentation at https://libgit2.github.com/libgit2, and a set of guides at https://libgit2.github.com/docs. For the other bindings, check the bundled README and tests; there are often small tutorials and pointers to further reading there.
If you want to use Git from within a Java program, there is a fully featured Git library called JGit. JGit is a relatively full-featured implementation of Git written natively in Java, and is widely used in the Java community. The JGit project is under the Eclipse umbrella, and its home can be found at http://www.eclipse.org/jgit.
There are a number of ways to connect your project with JGit and start writing code against it.
Probably the easiest is to use Maven – the integration is accomplished by adding the following snippet to the <dependencies>
tag in your pom.xml file:
<
dependency>
<
groupId>
org.eclipse.jgit<
/groupId>
<
artifactId>
org.eclipse.jgit<
/artifactId>
<
version>
3.5.0.201409260305-r<
/version>
<
/dependency>
The version
will most likely have advanced by the time you read this; check http://mvnrepository.com/artifact/org.eclipse.jgit/org.eclipse.jgit for updated repository information.
Once this step is done, Maven will automatically acquire and use the JGit libraries that you’ll need.
If you would rather manage the binary dependencies yourself, pre-built JGit binaries are available from http://www.eclipse.org/jgit/download. You can build them into your project by running a command like this:
javac -cp .:org.eclipse.jgit-3.5.0.201409260305-r.jar App.java
java -cp .:org.eclipse.jgit-3.5.0.201409260305-r.jar App
JGit has two basic levels of API: plumbing and porcelain. The terminology for these comes from Git itself, and JGit is divided into roughly the same kinds of areas: porcelain APIs are a friendly front-end for common user-level actions (the sorts of things a normal user would use the Git command-line tool for), while the plumbing APIs are for interacting with low-level repository objects directly.
The starting point for most JGit sessions is the Repository
class, and the first thing you’ll want to do is create an instance of it.
For a filesystem-based repository (yes, JGit allows for other storage models), this is accomplished using FileRepositoryBuilder
:
// Create a new repository
Repository
newlyCreatedRepo
=
FileRepositoryBuilder
.
create
(
new
File
(
"/tmp/new_repo/.git"
));
newlyCreatedRepo
.
create
();
// Open an existing repository
Repository
existingRepo
=
new
FileRepositoryBuilder
()
.
setGitDir
(
new
File
(
"my_repo/.git"
))
.
build
();
The builder has a fluent API for providing all the things it needs to find a Git repository, whether or not your program knows exactly where it’s located.
It can use environment variables (.readEnvironment()
), start from a place in the working directory and search (.setWorkTree(…).findGitDir()
), or just open a known .git
directory as above.
Once you have a Repository
instance, you can do all sorts of things with it.
Here’s a quick sampling:
// Get a reference
Ref
master
=
repo
.
getRef
(
"master"
);
// Get the object the reference points to
ObjectId
masterTip
=
master
.
getObjectId
();
// Rev-parse
ObjectId
obj
=
repo
.
resolve
(
"HEAD^{tree}"
);
// Load raw object contents
ObjectLoader
loader
=
repo
.
open
(
masterTip
);
loader
.
copyTo
(
System
.
out
);
// Create a branch
RefUpdate
createBranch1
=
repo
.
updateRef
(
"refs/heads/branch1"
);
createBranch1
.
setNewObjectId
(
masterTip
);
createBranch1
.
update
();
// Delete a branch
RefUpdate
deleteBranch1
=
repo
.
updateRef
(
"refs/heads/branch1"
);
deleteBranch1
.
setForceUpdate
(
true
);
deleteBranch1
.
delete
();
// Config
Config
cfg
=
repo
.
getConfig
();
String
name
=
cfg
.
getString
(
"user"
,
null
,
"name"
);
There’s quite a bit going on here, so let’s go through it one section at a time.
The first line gets a pointer to the master
reference.
JGit automatically grabs the actual master ref, which lives at refs/heads/master
, and returns an object that lets you fetch information about the reference.
You can get the name (.getName()
), and either the target object of a direct reference (.getObjectId()
) or the reference pointed to by a symbolic ref (.getTarget()
).
Ref objects are also used to represent tag refs and objects, so you can ask if the tag is “peeled,” meaning that it points to the final target of a (potentially long) string of tag objects.
The second line gets the target of the master
reference, which is returned as an ObjectId instance.
ObjectId represents the SHA-1 hash of an object, which might or might not exist in Git’s object database.
The third line is similar, but shows how JGit handles the rev-parse syntax (for more on this, see Branch References); you can pass any object specifier that Git understands, and JGit will return either a valid ObjectId for that object, or null
.
The next two lines show how to load the raw contents of an object.
In this example, we call ObjectLoader.copyTo()
to stream the contents of the object directly to stdout, but ObjectLoader also has methods to read the type and size of an object, as well as return it as a byte array.
For large objects (where .isLarge()
returns true
), you can call .openStream()
to get an InputStream-like object that can read the raw object data without pulling it all into memory at once.
The next few lines show what it takes to create a new branch.
We create a RefUpdate instance, configure some parameters, and call .update()
to trigger the change.
Directly following this is the code to delete that same branch.
Note that .setForceUpdate(true)
is required for this to work; otherwise the .delete()
call will return REJECTED
, and nothing will happen.
The last example shows how to fetch the user.name
value from the Git configuration files.
This Config instance uses the repository we opened earlier for local configuration, but will automatically detect the global and system configuration files and read values from them as well.
This is only a small sampling of the full plumbing API; there are many more methods and classes available.
Also not shown here is the way JGit handles errors, which is through the use of exceptions.
JGit APIs sometimes throw standard Java exceptions (such as IOException
), but there are a host of JGit-specific exception types that are provided as well (such as NoRemoteRepositoryException
, CorruptObjectException
, and NoMergeBaseException
).
The plumbing APIs are rather complete, but it can be cumbersome to string them together to achieve common goals, like adding a file to the index, or making a new commit.
JGit provides a higher-level set of APIs to help out with this, and the entry point to these APIs is the Git
class:
Repository
repo
;
// construct repo...
Git
git
=
new
Git
(
repo
);
The Git class has a nice set of high-level builder-style methods that can be used to construct some pretty complex behavior.
Let’s take a look at an example – doing something like git ls-remote
:
CredentialsProvider
cp
=
new
UsernamePasswordCredentialsProvider
(
"username"
,
"p4ssw0rd"
);
Collection
&
lt
;
Ref
&
gt
;
remoteRefs
=
git
.
lsRemote
()
.
setCredentialsProvider
(
cp
)
.
setRemote
(
"origin"
)
.
setTags
(
true
)
.
setHeads
(
false
)
.
call
();
for
(
Ref
ref
:
remoteRefs
)
{
System
.
out
.
println
(
ref
.
getName
()
+
" -> "
+
ref
.
getObjectId
().
name
());
}
This is a common pattern with the Git class; the methods return a command object that lets you chain method calls to set parameters, which are executed when you call .call()
.
In this case, we’re asking the origin
remote for tags, but not heads.
Also notice the use of a CredentialsProvider
object for authentication.
Many other commands are available through the Git class, including but not limited to add
, blame
, commit
, clean
, push
, rebase
, revert
, and reset
.
This is only a small sampling of JGit’s full capabilities. If you’re interested and want to learn more, here’s where to look for information and inspiration:
The official JGit API documentation is available online at http://download.eclipse.org/jgit/docs/latest/apidocs. These are standard Javadoc, so your favorite JVM IDE will be able to install them locally, as well.
The JGit Cookbook at https://github.com/centic9/jgit-cookbook has many examples of how to do specific tasks with JGit.
There are several good resources pointed out at http://stackoverflow.com/questions/6861881.