How do I find and replace every occurrence of:
subdomainA.example.com
with
subdomainB.example.com
in every text file under the /home/www/
directory tree recursively?
How do I find and replace every occurrence of:
subdomainA.example.com
with
subdomainB.example.com
in every text file under the /home/www/
directory tree recursively?
Note: Do not run this command on a folder including a git repo - changes to .git could corrupt your git index.
find /home/www -type f -print0 | xargs -0 sed -i \'s/subdomainA\\.example\\.com/subdomainB.example.com/g\'
From man find
:
-print0 (GNU find only) tells find to use the null character (\\0) instead of whitespace as the output delimiter between pathnames found. This is a safer option if you files can contain blanks or other special character. It is recommended to use the -print0 argument to find if you use -exec command or xargs (the -0 argument is needed in xargs.).
Note: Do not run this command on a folder including a git repo - changes to .git could corrupt your git index.
find /home/www/ -type f -exec \\
sed -i \'s/subdomainA\\.example\\.com/subdomainB.example.com/g\' {} +
Compared to other answers here, this is simpler than most and uses sed instead of perl, which is what the original question asked for.
The simplest way for me is
grep -rl oldtext . | xargs sed -i \'s/oldtext/newtext/g\'
All the tricks are almost the same, but I like this one:
find <mydir> -type f -exec sed -i \'s/<string1>/<string2>/g\' {} +
find <mydir>
: look up in the directory.
-type f
:
File is of type: regular file
-exec command {} +
:
This variant of the -exec action runs the specified command on the selected files, but the command line is built by appending each selected file name at the end; the total number of invocations of the command will be much less than the number of matched files. The command line is built in much the same way that xargs builds its command lines. Only one instance of `{}\' is allowed within the command. The command is executed in the starting directory.
cd /home/www && find . -type f -print0 |
xargs -0 perl -i.bak -pe \'s/subdomainA\\.example\\.com/subdomainB.example.com/g\'
For me the easiest solution to remember is https://stackoverflow.com/a/2113224/565525, i.e.:
sed -i \'\' -e \'s/subdomainA/subdomainB/g\' $(find /home/www/ -type f)
NOTE: -i \'\'
solves OSX problem sed: 1: \"...\": invalid command code .
NOTE: If there are too many files to process you\'ll get Argument list too long
. The workaround - use find -exec
or xargs
solution described above.
For anyone using silver searcher (ag
)
ag SearchString -l0 | xargs -0 sed -i \'s/SearchString/Replacement/g\'
Since ag ignores git/hg/svn file/folders by default, this is safe to run inside a repository.
To cut down on files to recursively sed
through, you could grep
for your string instance:
grep -rl <oldstring> /path/to/folder | xargs sed -i s^<oldstring>^<newstring>^g
If you run man grep
you\'ll notice you can also define an --exlude-dir=\"*.git\"
flag if you want to omit searching through .git directories, avoiding git index issues as others have politely pointed out.
Leading you to:
grep -rl --exclude-dir=\"*.git\" <oldstring> /path/to/folder | xargs sed -i s^<oldstring>^<newstring>^g
An one nice oneliner as an extra. Using git grep.
git grep -lz \'subdomainA.example.com\' | xargs -0 perl -i\'\' -pE \"s/subdomainA.example.com/subdomainB.example.com/g\"
This one is compatible with git repositories, and a bit simpler:
Linux:
git grep -l \'original_text\' | xargs sed -i \'s/original_text/new_text/g\'
Mac:
git grep -l \'original_text\' | xargs sed -i \'\' -e \'s/original_text/new_text/g\'
(Thanks to http://blog.jasonmeridth.com/posts/use-git-grep-to-replace-strings-in-files-in-your-git-repository/)
I just needed this and was not happy with the speed of the available examples. So I came up with my own:
cd /var/www && ack-grep -l --print0 subdomainA.example.com | xargs -0 perl -i.bak -pe \'s/subdomainA\\.example\\.com/subdomainB.example.com/g\'
Ack-grep is very efficient on finding relevant files. This command replaced ~145 000 files with a breeze whereas others took so long I couldn\'t wait until they finish.
find /home/www/ -type f -exec perl -i.bak -pe \'s/subdomainA\\.example\\.com/subdomainB.example.com/g\' {} +
find /home/www/ -type f
will list all files in /home/www/ (and its subdirectories).
The \"-exec\" flag tells find to run the following command on each file found.
perl -i.bak -pe \'s/subdomainA\\.example\\.com/subdomainB.example.com/g\' {} +
is the command run on the files (many at a time). The {}
gets replaced by file names.
The +
at the end of the command tells find
to build one command for many filenames.
Per the find
man page:
\"The command line is built in much the same way that
xargs builds its command lines.\"
Thus it\'s possible to achieve your goal (and handle filenames containing spaces) without using xargs -0
, or -print0
.
Try this:
sed -i \'s/subdomainA/subdomainB/g\' `grep -ril \'subdomainA\' *`
grep -lr \'subdomainA.example.com\' | while read file; do sed -i \"s/subdomainA.example.com/subdomainB.example.com/g\" \"$file\"; done
I guess most people don\'t know that they can pipe something into a \"while read file\" and it avoids those nasty -print0 args, while presevering spaces in filenames.
Further adding an echo
before the sed allows you to see what files will change before actually doing it.
You can use awk to solve this as below,
for file in `find /home/www -type f`
do
awk \'{gsub(/subdomainA.example.com/,\"subdomainB.example.com\"); print $0;}\' $file > ./tempFile && mv ./tempFile $file;
done
hope this will help you !!!
#!/usr/local/bin/bash -x
find * /home/www -type f | while read files
do
sedtest=$(sed -n \'/^/,/$/p\' \"${files}\" | sed -n \'/subdomainA/p\')
if [ \"${sedtest}\" ]
then
sed s\'/subdomainA/subdomainB/\'g \"${files}\" > \"${files}\".tmp
mv \"${files}\".tmp \"${files}\"
fi
done
If you do not mind using vim
together with grep
or find
tools, you could follow up the answer given by user Gert in this link --> How to do a text replacement in a big folder hierarchy?.
Here\'s the deal:
recursively grep for the string that you want to replace in a certain path, and take only the complete path of the matching file. (that would be the $(grep \'string\' \'pathname\' -Rl)
.
(optional) if you want to make a pre-backup of those files on centralized directory maybe you can use this also: cp -iv $(grep \'string\' \'pathname\' -Rl) \'centralized-directory-pathname\'
after that you can edit/replace at will in vim
following a scheme similar to the one provided on the link given:
:bufdo %s#string#replacement#gc | update
A bit old school but this worked on OS X.
There are few trickeries:
• Will only edit files with extension .sls
under the current directory
• .
must be escaped to ensure sed
does not evaluate them as \"any character\"
• ,
is used as the sed
delimiter instead of the usual /
Also note this is to edit a Jinja template to pass a variable
in the path of an import
(but this is off topic).
First, verify your sed command does what you want (this will only print the changes to stdout, it will not change the files):
for file in $(find . -name *.sls -type f); do echo -e \"\\n$file: \"; sed \'s,foo\\.bar,foo/bar/\\\"+baz+\\\"/,g\' $file; done
Edit the sed command as needed, once you are ready to make changes:
for file in $(find . -name *.sls -type f); do echo -e \"\\n$file: \"; sed -i \'\' \'s,foo\\.bar,foo/bar/\\\"+baz+\\\"/,g\' $file; done
Note the -i \'\'
in the sed command, I did not want to create a backup of the original files (as explained in In-place edits with sed on OS X or in Robert Lujo\'s comment in this page).
Happy seding folks!
just to avoid to change also
but still
(maybe not good in the idea behind domain root)
find /home/www/ -type f -exec sed -i \'s/\\bsubdomainA\\.example\\.com\\b/\\1subdomainB.example.com\\2/g\' {} \\;
According to this blog post:
find . -type f | xargs perl -pi -e \'s/oldtext/newtext/g;\'
I just use tops:
find . -name \'*.[c|cc|cp|cpp|m|mm|h]\' -print0 | xargs -0 tops -verbose replace \"verify_noerr(<b args>)\" with \"__Verify_noErr(<args>)\" \\
replace \"check(<b args>)\" with \"__Check(<args>)\"
Here\'s a version that should be more general than most; it doesn\'t require find
(using du
instead), for instance. It does require xargs
, which are only found in some versions of Plan 9 (like 9front).
du -a | awk -F\' \' \'{ print $2 }\' | xargs sed -i -e \'s/subdomainA\\.example\\.com/subdomainB.example.com/g\'
If you want to add filters like file extensions use grep
:
du -a | grep \"\\.scala$\" | awk -F\' \' \'{ print $2 }\' | xargs sed -i -e \'s/subdomainA\\.example\\.com/subdomainB.example.com/g\'
For Qshell (qsh) on IBMi, not bash as tagged by OP.
Limitations of qsh commands:
Thus the solution in qsh:
PATH=\'your/path/here\'
SEARCH=\\\'subdomainA.example.com\\\'
REPLACE=\\\'subdomainB.example.com\\\'
for file in $( find ${PATH} -P -type f ); do
TEMP_FILE=${file}.${RANDOM}.temp_file
if [ ! -e ${TEMP_FILE} ]; then
touch -C 819 ${TEMP_FILE}
sed -e \'s/\'$SEARCH\'/\'$REPLACE\'/g\' \\
< ${file} > ${TEMP_FILE}
mv ${TEMP_FILE} ${file}
fi
done
Caveats:
If you wanted to use this without completely destroying your SVN repository, you can tell \'find\' to ignore all hidden files by doing:
find . \\( ! -regex \'.*/\\..*\' \\) -type f -print0 | xargs -0 sed -i \'s/subdomainA.example.com/subdomainB.example.com/g\'
Using combination of grep
and sed
for pp in $(grep -Rl looking_for_string)
do
sed -i \'s/looking_for_string/something_other/g\' \"${pp}\"
done
For replace all occurrences in a git repository you can use:
git ls-files -z | xargs -0 sed -i \'s/subdomainA\\.example\\.com/subdomainB.example.com/g\'
See List files in local git repo? for other options to list all files in a repository. The -z
options tells git to separate the file names with a zero byte, which assures that xargs
(with the option -0
) can separate filenames, even if they contain spaces or whatnot.
perl -p -i -e \'s/oldthing/new_thingy/g\' `grep -ril oldthing *`
to change multiple files (and saving a backup as *.bak
):
perl -p -i -e \"s/\\|/x/g\" *
will take all files in directory and replace |
with x
called a “Perl pie” (easy as a pie)
A simpler way is to use the below on the command line
find /home/www/ -type f|xargs perl -pi -e \'s/subdomainA\\.example\\.com/subdomainB.example.com/g\'
This is the best all around solution I\'ve found for OSX and Windows (msys2). Should work with anything that can get the gnu version of sed. Skips the .git directories so it won\'t corrupt your checksums.
On mac, just install coreutils first and ensure gsed is in the path -
brew install coreutils
Then I stick this function in my zshrc/bashrc ->
replace-recursive() {
hash gsed 2>/dev/null && local SED_CMD=\"gsed\" || SED_CMD=\"sed\"
find . -type f -name \"*.*\" -not -path \"*/.git/*\" -print0 | xargs -0 $SED_CMD -i \"s/$1/$2/g\"
}
usage: replace-recursive <find> <replace>