Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

#100: implement repository commandlet #143

Merged
merged 81 commits into from
Mar 19, 2024
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
81 commits
Select commit Hold shift + click to select a range
e9d574f
added class RepositoryCommandlet and its help function
salimbouch Nov 8, 2023
76eba65
implemented run method when project is given as argument
salimbouch Nov 9, 2023
0e16de6
implemented loadProperties
salimbouch Nov 10, 2023
69835e3
added record RepositoryConfig, implemented run method, implemented lo…
salimbouch Nov 11, 2023
90145a6
implemented build functionality, import missing
salimbouch Nov 13, 2023
c738a0e
minor improvements
salimbouch Nov 13, 2023
c3de09e
javadoc
salimbouch Nov 14, 2023
c0fbd26
fixed bug: tool installed but not found
salimbouch Nov 16, 2023
89061ae
Merge branch 'main' into 100-implement-repository-commandlet
salimbouch Nov 16, 2023
1c729ae
removed useless improt
salimbouch Nov 28, 2023
01cb2b9
minor change
salimbouch Nov 28, 2023
db8008a
Update RepositoryCommandlet.java
salimbouch Nov 28, 2023
82cc617
changes after review
salimbouch Nov 30, 2023
dbc3bd3
Update cli/src/main/java/com/devonfw/tools/ide/commandlet/RepositoryC…
salimbouch Dec 13, 2023
a582601
Update cli/src/main/resources/nls/Ide_de.properties
salimbouch Dec 13, 2023
7e3bdd9
Update cli/src/main/java/com/devonfw/tools/ide/commandlet/RepositoryC…
salimbouch Dec 13, 2023
d71f68e
Update cli/src/main/java/com/devonfw/tools/ide/io/FileAccess.java
salimbouch Dec 13, 2023
1e5aba8
Update cli/src/main/java/com/devonfw/tools/ide/commandlet/RepositoryC…
salimbouch Dec 13, 2023
c8cf771
Update cli/src/main/resources/nls/Ide.properties
salimbouch Dec 13, 2023
4b60135
Update cli/src/main/resources/nls/Ide.properties
salimbouch Dec 13, 2023
061cfa5
Update cli/src/main/resources/nls/Ide_de.properties
salimbouch Dec 13, 2023
c314c08
reviewed changes
salimbouch Dec 13, 2023
e7a8323
Merge branch '100-implement-repository-commandlet' of https://github.…
salimbouch Dec 13, 2023
07d4a34
Update cli/src/main/java/com/devonfw/tools/ide/commandlet/RepositoryC…
salimbouch Dec 13, 2023
37da950
updates
salimbouch Dec 13, 2023
45e16e8
Merge branch '100-implement-repository-commandlet' of https://github.…
salimbouch Dec 13, 2023
05bcde1
reviewed changes
salimbouch Dec 13, 2023
e055a6a
Merge branch 'main' into 100-implement-repository-commandlet
salimbouch Dec 13, 2023
f2ee210
reviewed changes
salimbouch Dec 13, 2023
268a067
Merge branch '100-implement-repository-commandlet' of https://github.…
salimbouch Dec 13, 2023
5773121
implemented repositoryProperty
salimbouch Dec 15, 2023
d047d62
removed useless comment
salimbouch Dec 19, 2023
48db7c3
added null check
salimbouch Jan 2, 2024
dcecb50
Update RepositoryProperty.java
salimbouch Jan 2, 2024
4880d12
Update cli/src/main/java/com/devonfw/tools/ide/commandlet/RepositoryC…
salimbouch Jan 7, 2024
de061fe
Update cli/src/main/java/com/devonfw/tools/ide/commandlet/RepositoryC…
salimbouch Jan 7, 2024
e62ea03
Update cli/src/main/java/com/devonfw/tools/ide/property/RepositoryPro…
salimbouch Jan 7, 2024
8a35bbd
Update cli/src/main/java/com/devonfw/tools/ide/property/RepositoryPro…
salimbouch Jan 7, 2024
e8ba8f7
Update cli/src/main/java/com/devonfw/tools/ide/property/RepositoryPro…
salimbouch Jan 7, 2024
21f14df
reviewed changes
salimbouch Jan 8, 2024
b030586
Merge branch 'main' into 100-implement-repository-commandlet
hohwille Jan 8, 2024
f847820
Merge branch 'main' into 100-implement-repository-commandlet
salimbouch Jan 11, 2024
bb2beb8
Merge branch 'main' of https://github.com/devonfw/IDEasy into 100-imp…
salimbouch Jan 18, 2024
ff0d192
fixed conflicts
salimbouch Jan 23, 2024
bc7b48a
wrote test for repositoryCom
salimbouch Jan 25, 2024
e21f222
changed repositoryProperty to FileProperty inheritance
salimbouch Jan 26, 2024
d06a970
Merge branch 'main' of https://github.com/devonfw/IDEasy into 100-imp…
salimbouch Feb 2, 2024
df05c7c
Update Ide_de.properties
salimbouch Feb 2, 2024
3c0584b
Merge branch 'main' into 100-implement-repository-commandlet
salimbouch Feb 15, 2024
a218748
Merge branch 'main' into 100-implement-repository-commandlet
hohwille Feb 19, 2024
e0a2b50
Merge branch 'main' into 100-implement-repository-commandlet
salimbouch Feb 20, 2024
7b119df
Update cli/src/main/java/com/devonfw/tools/ide/io/FileAccessImpl.java
salimbouch Feb 21, 2024
a60cf62
Merge branch 'main' into 100-implement-repository-commandlet
salimbouch Feb 21, 2024
128dbcf
minor change
salimbouch Feb 27, 2024
216260c
Merge branch '100-implement-repository-commandlet' of https://github.…
salimbouch Feb 27, 2024
7a3c3c2
added tests for repo commandlet
salimbouch Feb 29, 2024
e5b794a
removed my stupid fix
salimbouch Feb 29, 2024
9254184
removed * import
salimbouch Mar 4, 2024
b490f16
adjusted tests
salimbouch Mar 6, 2024
424887f
Merge branch 'main' into 100-implement-repository-commandlet
hohwille Mar 12, 2024
2b99a21
Update cli/src/main/java/com/devonfw/tools/ide/property/RepositoryPro…
salimbouch Mar 13, 2024
6129a5a
Update cli/src/main/java/com/devonfw/tools/ide/property/RepositoryPro…
salimbouch Mar 13, 2024
4b5b005
Update cli/src/main/java/com/devonfw/tools/ide/commandlet/RepositoryC…
salimbouch Mar 13, 2024
5dd5d49
Merge branch 'main' of https://github.com/devonfw/ideasy into 100-imp…
salimbouch Mar 13, 2024
d079c78
reviewed changes
salimbouch Mar 13, 2024
34408ea
Merge branch '100-implement-repository-commandlet' of https://github.…
salimbouch Mar 13, 2024
7a9bb0b
minor change
salimbouch Mar 13, 2024
4236eae
crlf diff
salimbouch Mar 13, 2024
862eabc
diff war
salimbouch Mar 13, 2024
de2c3f9
solved minor bug
salimbouch Mar 13, 2024
6a1eefc
cleanup
salimbouch Mar 13, 2024
62fe8f2
Merge branch 'main' into 100-implement-repository-commandlet
salimbouch Mar 13, 2024
8a06af5
again crlf switching ..
salimbouch Mar 13, 2024
1752f0e
Merge branch '100-implement-repository-commandlet' of https://github.…
salimbouch Mar 13, 2024
b7e76d0
Update AbstractIdeContext.java
salimbouch Mar 13, 2024
6765d89
Update GitContextImpl.java
salimbouch Mar 13, 2024
6a8bf0e
Update GitContextImpl.java
salimbouch Mar 13, 2024
7b4bc57
Update GitContextImpl.java
salimbouch Mar 13, 2024
b73e83d
small git api improvements
salimbouch Mar 15, 2024
f513dfa
Update GitContextImpl.java
salimbouch Mar 15, 2024
5854687
Merge branch 'main' into 100-implement-repository-commandlet
hohwille Mar 19, 2024
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Original file line number Diff line number Diff line change
Expand Up @@ -67,6 +67,7 @@ public CommandletManagerImpl(IdeContext context) {
add(new EditionSetCommandlet(context));
add(new EditionListCommandlet(context));
add(new VersionCommandlet(context));
add(new RepositoryCommandlet(context));
add(new Gh(context));
add(new Helm(context));
add(new Java(context));
Expand Down
Original file line number Diff line number Diff line change
@@ -0,0 +1,126 @@
package com.devonfw.tools.ide.commandlet;

import com.devonfw.tools.ide.context.IdeContext;
import com.devonfw.tools.ide.property.PathProperty;
import com.devonfw.tools.ide.property.RepositoryProperty;
import com.devonfw.tools.ide.tool.ToolCommandlet;

import java.io.FileInputStream;
import java.io.IOException;
import java.io.InputStream;
import java.nio.file.Files;
import java.nio.file.Path;
import java.util.ArrayList;
import java.util.List;
import java.util.Properties;

import static com.devonfw.tools.ide.commandlet.RepositoryConfig.loadProperties;

/**
* {@link Commandlet} to setup one or multiple GIT repositories for development.
*/
public class RepositoryCommandlet extends Commandlet {

/** the repository to setup. */
public final RepositoryProperty repository;

/**
* The constructor.
*
* @param context the {@link IdeContext}.
*/
public RepositoryCommandlet(IdeContext context) {

super(context);
addKeyword(getName());
addKeyword("setup");
this.repository = add(new RepositoryProperty("", false, "repository"));
}

@Override
public String getName() {

return "repository";
}

@Override
public void run() {

Path repositoryFile = repository.getValue();

if (repositoryFile != null) {
// Handle the case when a specific repository is provided
doImportRepository(repositoryFile, true);
} else {
// If no specific repository is provided, check for repositories folder
Path repositoriesPath = this.context.getSettingsPath().resolve(IdeContext.FOLDER_REPOSITORIES);
Path legacyRepositoriesPath = this.context.getSettingsPath().resolve(IdeContext.FOLDER_LEGACY_REPOSITORIES);
Path repositories;
if (Files.exists(repositoriesPath)) {
repositories = repositoriesPath;
} else if (Files.exists(legacyRepositoriesPath)) {
repositories = legacyRepositoriesPath;
} else {
this.context.warning("Cannot find repositories folder nor projects folder.");
return;
}

List <Path> propertiesFiles = this.context.getFileAccess().listChildren(repositories,
path -> path.getFileName().toString().endsWith(".properties"));

boolean forceMode = this.context.isForceMode();
for (Path propertiesFile : propertiesFiles) {
doImportRepository(propertiesFile, forceMode);
}
}
}

private void doImportRepository(Path repositoryFile, boolean forceMode) {

this.context.info("Importing repository from {} ...", repositoryFile.getFileName().toString());
RepositoryConfig repositoryConfig = loadProperties(repositoryFile);

if (!repositoryConfig.active()) {
this.context.info("Repository is not active by default.");
if (forceMode) {
this.context.info("Repository setup is forced, hence proceeding ...");
} else {
this.context.info("Skipping repository - use force (-f) to setup all repositories ...");
return;
}
}

String repository = repositoryConfig.path();
String gitUrl = repositoryConfig.gitUrl();
if (repository == null || "".equals(repository) || gitUrl == null || "".equals(gitUrl)) {
this.context.warning("Invalid repository configuration {} - both 'path' and 'git-url' have to be defined."
, repositoryFile.getFileName().toString());
return;
}

this.context.debug(repositoryConfig.toString());

String workspace = repositoryConfig.workspace() != null ? repositoryConfig.workspace() : "main";
Path workspacePath = this.context.getIdeHome().resolve("workspaces").resolve(workspace);
this.context.getFileAccess().mkdirs(workspacePath);

Path repositoryPath = workspacePath.resolve(repository);
this.context.getGitContext().pullOrClone(gitUrl, repositoryConfig.gitBranch(), repositoryPath);

String buildCmd = repositoryConfig.buildCmd();
this.context.debug("Building repository with ide command: {}", buildCmd);
if (buildCmd != null && !buildCmd.isEmpty()) {
String[] command = buildCmd.split("\\s+");
ToolCommandlet commandlet = this.context.getCommandletManager().getToolCommandlet(command[0]);
List<String> args = new ArrayList<>(command.length - 1);
for (int i = 1; i < command.length; i++) {
args.add(command[i]);
}
commandlet.arguments.setValue(args);
commandlet.run();
} else {
this.context.info("Build command not set. Skipping build for repository.");
}

}
}
Original file line number Diff line number Diff line change
@@ -0,0 +1,65 @@
package com.devonfw.tools.ide.commandlet;

import java.io.FileInputStream;
import java.io.IOException;
import java.io.InputStream;
import java.nio.file.Path;
import java.util.Collections;
import java.util.Properties;
import java.util.Set;

/**
* Represents the configuration of a repository to be used by the {@link RepositoryCommandlet}.
*
* @param path Path into which the project is cloned. This path is relative to the workspace.
* @param workingSets The working sets associated with the repository.
* @param workspace Workspace to use for checkout and import. Default is main.
* @param gitUrl Git URL to use for cloning the project.
* @param gitBranch Git branch to checkout. Git default branch is default.
* @param buildPath The build path for the repository.
* @param buildCmd The command to invoke to build the repository after clone or pull. If omitted no build is triggered.
* @param imports list of IDEs where the repository will be imported to.
* @param active {@code true} to setup the repository during setup, {@code false} to skip.
*/
public record RepositoryConfig(
String path,
String workingSets,
String workspace,
String gitUrl,
String gitBranch,
String buildPath,
String buildCmd,
Set<String> imports,
boolean active) {
public static RepositoryConfig loadProperties(Path filePath) {

Properties properties = new Properties();
try (InputStream input = new FileInputStream(filePath.toString())) {
properties.load(input);
} catch (IOException e) {
throw new IllegalStateException("Failed to read file: " + filePath, e);
}

Set<String> importsSet = getImports(properties);

return new RepositoryConfig(properties.getProperty("path"), properties.getProperty("workingsets"),
properties.getProperty("workspace"), properties.getProperty("git_url"), properties.getProperty("git_branch"),
properties.getProperty(("build_path")), properties.getProperty("build_cmd"), importsSet,
Boolean.parseBoolean(properties.getProperty("active").trim()));
}

private static Set<String> getImports(Properties properties) {

String importProperty = properties.getProperty("import");
if (importProperty != null && !importProperty.isEmpty()) {
return Set.of(importProperty.split("\\s*,\\s*"));
}

String legacyImportProperty = properties.getProperty("eclipse");
if ("import".equals(legacyImportProperty)) {
return Set.of("eclipse");
} else {
return Collections.emptySet();
}
}
}
Original file line number Diff line number Diff line change
Expand Up @@ -497,7 +497,7 @@ public UrlMetadata getUrls() {

if (this.urlMetadata == null) {
if (!isTest()) {
this.getGitContext().pullOrFetchAndResetIfNeeded(IDE_URLS_GIT, this.urlsPath, "origin", "master");
this.getGitContext().pullOrFetchAndResetIfNeeded(IDE_URLS_GIT, "master", this.urlsPath, "origin");
}
this.urlMetadata = new UrlMetadata(this);
}
Expand Down
54 changes: 31 additions & 23 deletions cli/src/main/java/com/devonfw/tools/ide/context/GitContext.java
Original file line number Diff line number Diff line change
Expand Up @@ -13,63 +13,71 @@ public interface GitContext extends IdeLogger {
* Checks if the Git repository in the specified target folder needs an update by inspecting the modification time of
* a magic file.
*
* @param repoUrl the git remote URL to clone from. May be suffixed with a hash-sign ('#') followed by the branch name
* to check-out.
* @param repoUrl the git remote URL to clone from.
* @param targetRepository the {@link Path} to the target folder where the git repository should be cloned or pulled.
* It is not the parent directory where git will by default create a sub-folder by default on clone but the *
* final folder that will contain the ".git" subfolder.
* It is not the parent directory where git will by default create a sub-folder by default on clone but the * final
* folder that will contain the ".git" subfolder.
*/
void pullOrCloneIfNeeded(String repoUrl, Path targetRepository);
void pullOrCloneIfNeeded(String repoUrl, String branch, Path targetRepository);

/**
* Attempts a git pull and reset if required.
*
* @param repoUrl the git remote URL to clone from. May be suffixed with a hash-sign ('#') followed by the branch name
* to check-out.
* @param repoUrl the git remote URL to clone from.
* @param branch the branch name e.g. master.
* @param targetRepository the {@link Path} to the target folder where the git repository should be cloned or pulled.
* It is not the parent directory where git will by default create a sub-folder by default on clone but the *
* final folder that will contain the ".git" subfolder.
* It is not the parent directory where git will by default create a sub-folder by default on clone but the * final
* folder that will contain the ".git" subfolder.
* @param remoteName the remote name e.g. origin.
* @param branchName the branch name e.g. master.
*/
void pullOrFetchAndResetIfNeeded(String repoUrl, Path targetRepository, String remoteName, String branchName);
void pullOrFetchAndResetIfNeeded(String repoUrl, String branch, Path targetRepository, String remoteName);

/**
* Runs a git pull or a git clone.
*
* @param gitRepoUrl the git remote URL to clone from. May be suffixed with a hash-sign ('#') followed by the branch
* name to check-out.
* @param gitRepoUrl the git remote URL to clone from.
* @param targetRepository the {@link Path} to the target folder where the git repository should be cloned or pulled.
* It is not the parent directory where git will by default create a sub-folder by default on clone but the *
* final folder that will contain the ".git" subfolder.
* It is not the parent directory where git will by default create a sub-folder by default on clone but the * final
* folder that will contain the ".git" subfolder.
*/
void pullOrClone(String gitRepoUrl, Path targetRepository);

/**
* Runs a git pull or a git clone.
*
* @param gitRepoUrl the git remote URL to clone from.
* @param branch the branch name e.g. master.
* @param targetRepository the {@link Path} to the target folder where the git repository should be cloned or pulled.
* It is not the parent directory where git will by default create a sub-folder by default on clone but the * final
* folder that will contain the ".git" subfolder.
*/
void pullOrClone(String gitRepoUrl, String branch, Path targetRepository);

/**
* Runs a git clone. Throws a CliException if in offline mode.
*
* @param gitRepoUrl the {@link GitUrl} to use for the repository URL.
* @param targetRepository the {@link Path} to the target folder where the git repository should be cloned or pulled.
* It is not the parent directory where git will by default create a sub-folder by default on clone but the *
* final folder that will contain the ".git" subfolder.
* It is not the parent directory where git will by default create a sub-folder by default on clone but the * final
* folder that will contain the ".git" subfolder.
*/
void clone(GitUrl gitRepoUrl, Path targetRepository);

/**
* Runs a git pull.
*
* @param targetRepository the {@link Path} to the target folder where the git repository should be cloned or pulled.
* It is not the parent directory where git will by default create a sub-folder by default on clone but the *
* final folder that will contain the ".git" subfolder.
* It is not the parent directory where git will by default create a sub-folder by default on clone but the * final
* folder that will contain the ".git" subfolder.
*/
void pull(Path targetRepository);

/**
* Runs a git reset if files were modified.
*
* @param targetRepository the {@link Path} to the target folder where the git repository should be cloned or pulled.
* It is not the parent directory where git will by default create a sub-folder by default on clone but the *
* final folder that will contain the ".git" subfolder.
* It is not the parent directory where git will by default create a sub-folder by default on clone but the * final
* folder that will contain the ".git" subfolder.
* @param remoteName the remote server name.
* @param branchName the name of the branch.
*/
Expand All @@ -79,8 +87,8 @@ public interface GitContext extends IdeLogger {
* Runs a git cleanup if untracked files were found.
*
* @param targetRepository the {@link Path} to the target folder where the git repository should be cloned or pulled.
* It is not the parent directory where git will by default create a sub-folder by default on clone but the *
* final folder that will contain the ".git" subfolder.
* It is not the parent directory where git will by default create a sub-folder by default on clone but the * final
* folder that will contain the ".git" subfolder.
*/
void cleanup(Path targetRepository);

Expand Down
Loading
Loading