YouTip

[ Linux Command Manual](#) * * * iconv is a command-line tool in Linux systems used to convert text file content between different character encodings. It can handle various common character encoding formats such as UTF-8, GB2312, ISO-8859, etc., solving text encoding incompatibility issues between different systems. * * * ## Why Character Encoding Conversion is Needed Character encoding issues often cause the following situations: * Text files copied from Windows to Linux display garbled characters * Web content displays abnormally in different browsers * Source code files in cross-platform development have encoding issues * Compatibility issues when processing international multilingual text The iconv command is designed to solve these problems. * * * ## Basic Syntax iconv -f original_encoding -t target_encoding * * * ## Common Option Parameters | Option | Description | | --- | --- | | `-f` | Specify the original file's character encoding (from) | | `-t` | Specify the target character encoding to convert to (to) | | `-o` | Specify the output file (default outputs to standard output) | | `-l` | List all supported encoding formats | | `-c` | Silently ignore characters that cannot be converted (default reports error) | | `--verbose` | Display detailed information during conversion | * * * ## Supported Encoding Formats To view all encoding formats supported by the system, run: iconv -l Common encoding formats include: * UTF-8 * GB2312 * GBK * GB18030 * BIG5 * ISO-8859-1 (Latin-1) * ASCII * EUC-JP (Japanese) * SHIFT_JIS (Japanese) * * * ## Practical Application Examples ### Example 1: Basic Encoding Conversion Convert a GB2312 encoded file to UTF-8: iconv -f GB2312 -t UTF-8 input.txt -o output.txt ### Example 2: Processing Standard Input and Output Convert text through a pipe: cat gb2312_file.txt | iconv -f GB2312 -t UTF-8 ### Example 3: Ignoring Characters That Cannot Be Converted iconv -f GBK -t UTF-8//IGNORE input.txt -o output.txt ### Example 4: Batch Conversion of All Files in a Directory ## Example for file in*.txt; do iconv -f GB2312 -t UTF-8"$file"-o"utf8_${file}" done * * * ## Common Problem Solutions ### Problem 1: Encoding Recognition Error If you don't know the file's original encoding, you can try common encodings first: ## Example # Try GB2312 iconv -f GB2312 -t UTF-8 input.txt # If it fails, try GBK iconv -f GBK -t UTF-8 input.txt ### Problem 2: Garbled Characters Remain After Conversion The encoding may be incorrectly specified, try: ## Example # Use //TRANSLIT to handle special characters iconv -f GBK -t UTF-8//TRANSLIT input.txt # Or use //IGNORE to ignore characters that cannot be converted iconv -f GBK -t UTF-8//IGNORE input.txt ### Problem 3: Insufficient Memory for Large File Conversion For large files, you can use split processing: ## Example split-l 10000 bigfile.txt part_ for part in part_*; do iconv -f GB2312 -t UTF-8"$part"-o"utf8_${part}" done cat utf8_part_*> bigfile_utf8.txt * * * ## Best Practice Recommendations 1. **Backup original files**: Back up before conversion to prevent data loss 2. **Test conversion**: Test conversion effects with small files first 3. **Unified encoding**: Use unified encoding standards in projects (UTF-8 recommended) 4. **Check results**: Use the `file` command to check file encoding after conversion 5. **Automate processing**: Write commonly used conversion commands into scripts for reuse * * * ## Combined Use with Other Tools ### Combined with find command for batch conversion find . -name "*.txt" -exec bash -c 'iconv -f GB2312 -t UTF-8 "{}" > "{}.utf8"' ; ### Combined with vim to check encoding vim -c "set fileencoding" filename.txt ### Using file command to detect encoding file -i filename.txt * * * ## Advanced Techniques ### Converting filename encoding ## Example # Convert GBK encoded filenames to UTF-8 convmv -f GBK -t UTF-8--notest*.txt ### Processing HTML/XML files ## Example # Preserve encoding declarations in files iconv -f GB2312 -t UTF-8 input.html | sed's/charset=gb2312/charset=utf-8/i'> output.html ### Creating encoding conversion aliases Add to `~/.bashrc`: ## Example alias gb2utf8='iconv -f GB2312 -t UTF-8' alias big52utf8='iconv -f BIG5 -t UTF-8' Then execute `source ~/.bashrc` to make the aliases effective. * * * ## Summary iconv is a powerful tool for handling text encoding issues in Linux systems. Through this tutorial, you should be able to: 1. Understand the basic concepts of character encoding conversion 2. Master the basic syntax and common options of the iconv command 3. Solve encoding conversion problems in daily work 4. Apply advanced techniques to handle complex scenarios Remember to always backup important files before processing, and verify results after conversion. UTF-8, as a universal encoding standard, is the recommended choice for most modern applications. * * Linux Command Manual](#)