Merge -r 1384832:1384833 from trunk to branch-2. Fixes: HADOOP-8780. Update DeprecatedProperties apt file.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1384835 13f79535-47bb-0310-9956-ffa450edef68
This commit is contained in:
Thomas White
parent
ac103a4314
commit
9e1860bfbf
|
|
@ -1,7 +1,219 @@
|
|||
Hadoop Change Log
|
||||
|
||||
Release 2.0.3-alpha - Unreleased
|
||||
|
||||
Trunk (Unreleased)
|
||||
|
||||
INCOMPATIBLE CHANGES
|
||||
|
||||
HADOOP-8124. Remove the deprecated FSDataOutputStream constructor,
|
||||
FSDataOutputStream.sync() and Syncable.sync(). (szetszwo)
|
||||
|
||||
NEW FEATURES
|
||||
|
||||
HADOOP-8469. Make NetworkTopology class pluggable. (Junping Du via
|
||||
szetszwo)
|
||||
|
||||
HADOOP-8470. Add NetworkTopologyWithNodeGroup, a 4-layer implementation
|
||||
of NetworkTopology. (Junping Du via szetszwo)
|
||||
|
||||
IMPROVEMENTS
|
||||
|
||||
HADOOP-8017. Configure hadoop-main pom to get rid of M2E plugin execution
|
||||
not covered (Eric Charles via bobby)
|
||||
|
||||
HADOOP-8015. ChRootFileSystem should extend FilterFileSystem
|
||||
(Daryn Sharp via bobby)
|
||||
|
||||
HADOOP-7595. Upgrade dependency to Avro 1.5.3. (Alejandro Abdelnur via atm)
|
||||
|
||||
HADOOP-7664. Remove warmings when overriding final parameter configuration
|
||||
if the override value is same as the final parameter value.
|
||||
(Ravi Prakash via suresh)
|
||||
|
||||
HADOOP-7729. Send back valid HTTP response if user hits IPC port with
|
||||
HTTP GET. (todd)
|
||||
|
||||
HADOOP-7792. Add verifyToken method to AbstractDelegationTokenSecretManager.
|
||||
(jitendra)
|
||||
|
||||
HADOOP-7688. Add servlet handler check in HttpServer.start().
|
||||
(Uma Maheswara Rao G via szetszwo)
|
||||
|
||||
HADOOP-7886. Add toString to FileStatus. (SreeHari via jghoman)
|
||||
|
||||
HADOOP-7808. Port HADOOP-7510 - Add configurable option to use original
|
||||
hostname in token instead of IP to allow server IP change.
|
||||
(Daryn Sharp via suresh)
|
||||
|
||||
HADOOP-7987. Support setting the run-as user in unsecure mode. (jitendra)
|
||||
|
||||
HADOOP-7988. Upper case in hostname part of the principals doesn't work with
|
||||
kerberos. (jitendra)
|
||||
|
||||
HADOOP-8078. Add capability to turn on security in unit tests. (Jaimin Jetly
|
||||
via jitendra)
|
||||
|
||||
HADOOP-7994. Remove getProtocolVersion and getProtocolSignature from the
|
||||
client side translator and server side implementation. (jitendra)
|
||||
|
||||
HADOOP-7757. Test file reference count is at least 3x actual value (Jon
|
||||
Eagles via bobby)
|
||||
|
||||
HADOOP-8147. test-patch should run tests with -fn to avoid masking test
|
||||
failures (Robert Evans via tgraves)
|
||||
|
||||
HADOOP-8290. Remove remaining references to hadoop.native.lib (harsh)
|
||||
|
||||
HADOOP-8308. Support cross-project Jenkins builds. (tomwhite)
|
||||
|
||||
HADOOP-8297. Writable javadocs don't carry default constructor (harsh)
|
||||
|
||||
HADOOP-8360. empty-configuration.xml fails xml validation
|
||||
(Radim Kolar via harsh)
|
||||
|
||||
HADOOP-8367 Improve documentation of declaringClassProtocolName in rpc headers
|
||||
(Sanjay Radia)
|
||||
|
||||
HADOOP-8415. Add getDouble() and setDouble() in
|
||||
org.apache.hadoop.conf.Configuration (Jan van der Lugt via harsh)
|
||||
|
||||
HADOOP-7659. fs -getmerge isn't guaranteed to work well over non-HDFS
|
||||
filesystems (harsh)
|
||||
|
||||
HADOOP-8059. Add javadoc to InterfaceAudience and InterfaceStability.
|
||||
(Brandon Li via suresh)
|
||||
|
||||
HADOOP-8434. Add tests for Configuration setter methods.
|
||||
(Madhukara Phatak via suresh)
|
||||
|
||||
HADOOP-8523. test-patch.sh doesn't validate patches before building
|
||||
(Jack Dintruff via jeagles)
|
||||
|
||||
HADOOP-8624. ProtobufRpcEngine should log all RPCs if TRACE logging is
|
||||
enabled (todd)
|
||||
|
||||
HADOOP-8711. IPC Server supports adding exceptions for which
|
||||
the message is printed and the stack trace is not printed to avoid chatter.
|
||||
(Brandon Li via Suresh)
|
||||
|
||||
HADOOP-8719. Workaround for kerberos-related log errors upon running any
|
||||
hadoop command on OSX. (Jianbin Wei via harsh)
|
||||
|
||||
HADOOP-8619. WritableComparator must implement no-arg constructor.
|
||||
(Chris Douglas via Suresh)
|
||||
|
||||
HADOOP-8736. Add Builder for building RPC server. (Brandon Li via Suresh)
|
||||
|
||||
BUG FIXES
|
||||
|
||||
HADOOP-8177. MBeans shouldn't try to register when it fails to create MBeanName.
|
||||
(Devaraj K via umamahesh)
|
||||
|
||||
HADOOP-7900. LocalDirAllocator confChanged() accesses conf.get() twice
|
||||
(Ravi Gummadi via Uma Maheswara Rao G)
|
||||
|
||||
HADOOP-8146. FsShell commands cannot be interrupted
|
||||
(Daryn Sharp via Uma Maheswara Rao G)
|
||||
|
||||
HADOOP-8018. Hudson auto test for HDFS has started throwing javadoc
|
||||
(Jon Eagles via bobby)
|
||||
|
||||
HADOOP-8001 ChecksumFileSystem's rename doesn't correctly handle checksum
|
||||
files. (Daryn Sharp via bobby)
|
||||
|
||||
HADOOP-8006 TestFSInputChecker is failing in trunk.
|
||||
(Daryn Sharp via bobby)
|
||||
|
||||
HADOOP-7998. CheckFileSystem does not correctly honor setVerifyChecksum
|
||||
(Daryn Sharp via bobby)
|
||||
|
||||
HADOOP-7606. Upgrade Jackson to version 1.7.1 to match the version required
|
||||
by Jersey (Alejandro Abdelnur via atm)
|
||||
|
||||
HADOOP-7610. Fix for hadoop debian package (Eric Yang via gkesavan)
|
||||
|
||||
HADOOP-7641. Add Apache License to template config files.
|
||||
(Eric Yang via atm)
|
||||
|
||||
HADOOP-7621. alfredo config should be in a file not readable by users
|
||||
(Alejandro Abdelnur via atm)
|
||||
|
||||
HADOOP-7669 Fix newly introduced release audit warning.
|
||||
(Uma Maheswara Rao G via stevel)
|
||||
|
||||
HADOOP-6220. HttpServer wraps InterruptedExceptions by IOExceptions
|
||||
if interrupted in startup (stevel)
|
||||
|
||||
HADOOP-7703. Improved exception handling of shutting down web server.
|
||||
(Devaraj K via Eric Yang)
|
||||
|
||||
HADOOP-7704. Reduce number of object created by JMXJsonServlet.
|
||||
(Devaraj K via Eric Yang)
|
||||
|
||||
HADOOP-7769. TestJMXJsonServlet is failing. (tomwhite)
|
||||
|
||||
HADOOP-7770. ViewFS getFileChecksum throws FileNotFoundException for files in
|
||||
/tmp and /user. (Ravi Prakash via jitendra)
|
||||
|
||||
HADOOP-8141. Add method to SecurityUtil to init krb5 cipher suites.
|
||||
(todd)
|
||||
|
||||
HADOOP-7788. Add simple HealthMonitor class to watch an HAService (todd)
|
||||
|
||||
HADOOP-8312. testpatch.sh should provide a simpler way to see which
|
||||
warnings changed (bobby)
|
||||
|
||||
HADOOP-8339. jenkins complaining about 16 javadoc warnings
|
||||
(Tom White and Robert Evans via tgraves)
|
||||
|
||||
HADOOP-8354. test-patch findbugs may fail if a dependent module is changed
|
||||
(Tom White and Robert Evans)
|
||||
|
||||
HADOOP-8375. test-patch should stop immediately once it has found
|
||||
compilation errors (bobby)
|
||||
|
||||
HADOOP-8395. Text shell command unnecessarily demands that a
|
||||
SequenceFile's key class be WritableComparable (harsh)
|
||||
|
||||
HADOOP-8413. test-patch.sh gives out the wrong links for
|
||||
newPatchFindbugsWarnings (Colin Patrick McCabe via bobby)
|
||||
|
||||
HADOOP-6871. When the value of a configuration key is set to its
|
||||
unresolved form, it causes the IllegalStateException in
|
||||
Configuration.get() stating that substitution depth is too large.
|
||||
(Arvind Prabhakar via harsh)
|
||||
|
||||
HADOOP-8548. test-patch.sh shows an incorrect link in Jekins builds
|
||||
(Kihwal Lee via bobby)
|
||||
|
||||
HADOOP-8110. Fix trash checkpoint collisions (Jason Lowe via daryn)
|
||||
|
||||
HADOOP-8584. test-patch.sh should not immediately exit when no
|
||||
tests are added or modified. (Colin Patrick McCabe via eli)
|
||||
|
||||
HADOOP-8521. Port StreamInputFormat to new Map Reduce API (madhukara
|
||||
phatak via bobby)
|
||||
|
||||
HADOOP-8593. Add missed @Override annotations in Metric/Metrics2 package.
|
||||
(Brandon Li via suresh)
|
||||
|
||||
HADOOP-8623. hadoop jar command should respect HADOOP_OPTS.
|
||||
(Steven Willis via suresh)
|
||||
|
||||
HADOOP-8684. Deadlock between WritableComparator and WritableComparable.
|
||||
(Jing Zhao via suresh)
|
||||
|
||||
HADOOP-8786. HttpServer continues to start even if AuthenticationFilter
|
||||
fails to init (todd)
|
||||
|
||||
HADOOP-8767. Secondary namenode is started on slave nodes instead of
|
||||
master nodes. (Giovanni Delussu via suresh)
|
||||
|
||||
OPTIMIZATIONS
|
||||
|
||||
HADOOP-7761. Improve the performance of raw comparisons. (todd)
|
||||
|
||||
Release 2.0.3-alpha - Unreleased
|
||||
|
||||
INCOMPATIBLE CHANGES
|
||||
|
||||
NEW FEATURES
|
||||
|
|
@ -19,16 +231,13 @@ Release 2.0.3-alpha - Unreleased
|
|||
|
||||
OPTIMIZATIONS
|
||||
|
||||
BUG FIXES
|
||||
|
||||
HADOOP-7688. When a servlet filter throws an exception in init(..), the
|
||||
Jetty server failed silently. (umamahesh)
|
||||
BUG FIXES
|
||||
|
||||
HADOOP-8795. BASH tab completion doesn't look in PATH, assumes path to
|
||||
executable is specified. (Sean Mackrory via atm)
|
||||
|
||||
HADOOP-8786. HttpServer continues to start even if AuthenticationFilter
|
||||
fails to init. (Todd Lipcon via umamahesh)
|
||||
HADOOP-8780. Update DeprecatedProperties apt file. (Ahmed Radwan via
|
||||
tomwhite)
|
||||
|
||||
Release 2.0.2-alpha - 2012-09-07
|
||||
|
||||
|
|
@ -39,10 +248,10 @@ Release 2.0.2-alpha - 2012-09-07
|
|||
|
||||
HADOOP-8689. Make trash a server side configuration option. (eli)
|
||||
|
||||
HADOOP-8710. Remove ability for users to easily run the trash emptier. (eli)
|
||||
HADOOP-8710. Remove ability for users to easily run the trash emptire. (eli)
|
||||
|
||||
NEW FEATURES
|
||||
|
||||
|
||||
HDFS-3042. Automatic failover support for NameNode HA (todd)
|
||||
(see dedicated section below for breakdown of subtasks)
|
||||
|
||||
|
|
@ -77,12 +286,15 @@ Release 2.0.2-alpha - 2012-09-07
|
|||
|
||||
HADOOP-8398. Cleanup BlockLocation. (eli)
|
||||
|
||||
HADOOP-8403. bump up POMs version to 2.0.1-SNAPSHOT. (tucu)
|
||||
HADOOP-8422. Deprecate FileSystem#getDefault* and getServerDefault
|
||||
methods that don't take a Path argument. (eli)
|
||||
|
||||
HADOOP-8323. Add javadoc and tests for Text.clear() behavior (harsh)
|
||||
|
||||
HADOOP-8358. Config-related WARN for dfs.web.ugi can be avoided. (harsh)
|
||||
|
||||
HADOOP-8450. Remove src/test/system. (eli)
|
||||
|
||||
HADOOP-8244. Improve comments on ByteBufferReadable.read. (Henry Robinson
|
||||
via atm)
|
||||
|
||||
|
|
@ -113,13 +325,22 @@ Release 2.0.2-alpha - 2012-09-07
|
|||
|
||||
HADOOP-8541. Better high-percentile latency metrics. (Andrew Wang via atm)
|
||||
|
||||
HADOOP-8362. Improve exception message when Configuration.set() is called with a null key or value. (Madhukara Phatak and Suresh Srinivas via harsh)
|
||||
HADOOP-8362. Improve exception message when Configuration.set() is
|
||||
called with a null key or value. (Madhukara Phatak
|
||||
and Suresh Srinivas via harsh)
|
||||
|
||||
HADOOP-8624. ProtobufRpcEngine should log all RPCs if TRACE logging is
|
||||
enabled (todd)
|
||||
HADOOP-7818. DiskChecker#checkDir should fail if the directory is
|
||||
not executable. (Madhukara Phatak via harsh)
|
||||
|
||||
HADOOP-8623. hadoop jar command should respect HADOOP_OPTS.
|
||||
(Steven Willis via suresh)
|
||||
HADOOP-8531. SequenceFile Writer can throw out a better error if a
|
||||
serializer or deserializer isn't available
|
||||
(Madhukara Phatak via harsh)
|
||||
|
||||
HADOOP-8609. IPC server logs a useless message when shutting down socket.
|
||||
(Jon Zuanich via atm)
|
||||
|
||||
HADOOP-8620. Add -Drequire.fuse and -Drequire.snappy. (Colin
|
||||
Patrick McCabe via eli)
|
||||
|
||||
HADOOP-8687. Upgrade log4j to 1.2.17. (eli)
|
||||
|
||||
|
|
@ -150,8 +371,8 @@ Release 2.0.2-alpha - 2012-09-07
|
|||
HADOOP-8372. NetUtils.normalizeHostName() incorrectly handles hostname
|
||||
starting with a numeric character. (Junping Du via suresh)
|
||||
|
||||
HADOOP-8393. hadoop-config.sh missing variable exports, causes Yarn
|
||||
jobs to fail with ClassNotFoundException MRAppMaster. (phunt via tucu)
|
||||
HADOOP-8393. hadoop-config.sh missing variable exports, causes Yarn jobs
|
||||
to fail with ClassNotFoundException MRAppMaster. (phunt via tucu)
|
||||
|
||||
HADOOP-8316. Audit logging should be disabled by default. (eli)
|
||||
|
||||
|
|
@ -188,8 +409,8 @@ Release 2.0.2-alpha - 2012-09-07
|
|||
|
||||
HADOOP-8485. Don't hardcode "Apache Hadoop 0.23" in the docs. (eli)
|
||||
|
||||
HADOOP-8488. test-patch.sh gives +1 even if the native build
|
||||
fails. (Colin Patrick McCabe via eli)
|
||||
HADOOP-8488. test-patch.sh gives +1 even if the native build fails.
|
||||
(Colin Patrick McCabe via eli)
|
||||
|
||||
HADOOP-8507. Avoid OOM while deserializing DelegationTokenIdentifer.
|
||||
(Colin Patrick McCabe via eli)
|
||||
|
|
@ -267,14 +488,6 @@ Release 2.0.2-alpha - 2012-09-07
|
|||
HADOOP-8699. some common testcases create core-site.xml in test-classes
|
||||
making other testcases to fail. (tucu)
|
||||
|
||||
HADOOP-8660. TestPseudoAuthenticator failing with NPE. (tucu)
|
||||
|
||||
HADOOP-7703. Improved excpetion handling of shutting down web server.
|
||||
(Devaraj K via Eric Yang)
|
||||
|
||||
HADOOP-8699. some common testcases create core-site.xml in test-classes
|
||||
making other testcases to fail. (tucu)
|
||||
|
||||
HADOOP-8031. Configuration class fails to find embedded .jar resources;
|
||||
should use URL.openStream() (genman via tucu)
|
||||
|
||||
|
|
@ -290,6 +503,8 @@ Release 2.0.2-alpha - 2012-09-07
|
|||
|
||||
HADOOP-8764. CMake: HADOOP-8737 broke ARM build. (Trevor Robinson via eli)
|
||||
|
||||
HADOOP-8770. NN should not RPC to self to find trash defaults. (eli)
|
||||
|
||||
HADOOP-8648. libhadoop: native CRC32 validation crashes when
|
||||
io.bytes.per.checksum=1. (Colin Patrick McCabe via eli)
|
||||
|
||||
|
|
@ -390,9 +605,6 @@ Release 2.0.0-alpha - 05-23-2012
|
|||
HADOOP-7776. Make the Ipc-Header in a RPC-Payload an explicit header.
|
||||
(sanjay)
|
||||
|
||||
HADOOP-7717. Move handling of concurrent client fail-overs to
|
||||
RetryInvocationHandler (atm)
|
||||
|
||||
HADOOP-7862. Move the support for multiple protocols to lower layer so
|
||||
that Writable, PB and Avro can all use it (Sanjay)
|
||||
|
||||
|
|
@ -414,25 +626,23 @@ Release 2.0.0-alpha - 05-23-2012
|
|||
HADOOP-8085. Add RPC metrics to ProtobufRpcEngine. (Hari Mankude via
|
||||
suresh)
|
||||
|
||||
HADOOP-7621. alfredo config should be in a file not readable by users
|
||||
(Alejandro Abdelnur via atm)
|
||||
HADOOP-8098. KerberosAuthenticatorHandler should use _HOST replacement to
|
||||
resolve principal name (tucu)
|
||||
|
||||
HADOOP-8118. In metrics2.util.MBeans, change log level to trace for the
|
||||
stack trace of InstanceAlreadyExistsException. (szetszwo)
|
||||
|
||||
HADOOP-7994. Remove getProtocolVersion and getProtocolSignature from the
|
||||
client side translator and server side implementation. (jitendra)
|
||||
|
||||
HADOOP-8125. make hadoop-client set of curated jars available in a
|
||||
distribution tarball (rvs via tucu)
|
||||
|
||||
HADOOP-8142. Update versions from 0.23.2 to 0.23.3 in the build files.
|
||||
(szetszwo)
|
||||
HADOOP-7717. Move handling of concurrent client fail-overs to
|
||||
RetryInvocationHandler (atm)
|
||||
|
||||
HADOOP-8141. Add method to SecurityUtil to init krb5 cipher suites.
|
||||
(todd)
|
||||
HADOOP-7728. Enable task memory management to be configurable in hadoop
|
||||
config setup script. (ramya)
|
||||
|
||||
HADOOP-7358. Improve log levels when exceptions caught in RPC handler
|
||||
(Todd Lipcon via shv)
|
||||
|
||||
HADOOP-7557 Make IPC header be extensible (sanjay radia)
|
||||
|
||||
|
|
@ -443,7 +653,10 @@ Release 2.0.0-alpha - 05-23-2012
|
|||
|
||||
HADOOP-8183. Stop using "mapred.used.genericoptions.parser" (harsh)
|
||||
|
||||
HADOOP-7788. Add simple HealthMonitor class to watch an HAService (todd)
|
||||
HADOOP-6924. Adds a directory to the list of directories to search
|
||||
for the libjvm.so file. The new directory is found by running a 'find'
|
||||
command and the first output is taken. This was done to handle the
|
||||
build of Hadoop with IBM's JDK. (Stephen Watt, Guillermo Cabrera and ddas)
|
||||
|
||||
HADOOP-8200. Remove HADOOP_[JOBTRACKER|TASKTRACKER]_OPTS. (eli)
|
||||
|
||||
|
|
@ -490,7 +703,8 @@ Release 2.0.0-alpha - 05-23-2012
|
|||
|
||||
HADOOP-7549. Use JDK ServiceLoader mechanism to find FileSystem implementations. (tucu)
|
||||
|
||||
HADOOP-8185. Update namenode -format documentation and add -nonInteractive and -force. (Arpit Gupta via atm)
|
||||
HADOOP-8185. Update namenode -format documentation and add -nonInteractive
|
||||
and -force. (Arpit Gupta via atm)
|
||||
|
||||
HADOOP-8214. make hadoop script recognize a full set of deprecated commands (rvs via tucu)
|
||||
|
||||
|
|
@ -513,31 +727,12 @@ Release 2.0.0-alpha - 05-23-2012
|
|||
|
||||
HADOOP-8366 Use ProtoBuf for RpcResponseHeader (sanjay radia)
|
||||
|
||||
HADOOP-8620. Add -Drequire.fuse and -Drequire.snappy. (Colin
|
||||
Patrick McCabe via eli)
|
||||
|
||||
OPTIMIZATIONS
|
||||
|
||||
HADOOP-8422. Deprecate FileSystem#getDefault* and getServerDefault
|
||||
methods that don't take a Path argument. (eli)
|
||||
|
||||
HADOOP-7818. DiskChecker#checkDir should fail if the directory is
|
||||
not executable. (Madhukara Phatak via harsh)
|
||||
|
||||
HADOOP-8531. SequenceFile Writer can throw out a better error if a
|
||||
serializer or deserializer isn't available
|
||||
(Madhukara Phatak via harsh)
|
||||
|
||||
HADOOP-8609. IPC server logs a useless message when shutting down socket.
|
||||
(Jon Zuanich via atm)
|
||||
|
||||
BUG FIXES
|
||||
|
||||
HADOOP-8199. Fix issues in start-all.sh and stop-all.sh (Devaraj K via umamahesh)
|
||||
|
||||
HADOOP-7900. LocalDirAllocator confChanged() accesses conf.get() twice
|
||||
(Ravi Gummadi via Uma Maheswara Rao G)
|
||||
|
||||
|
||||
HADOOP-7635. RetryInvocationHandler should release underlying resources on
|
||||
close. (atm)
|
||||
|
||||
|
|
@ -759,13 +954,8 @@ Release 0.23.3 - UNRELEASED
|
|||
|
||||
HADOOP-8535. Cut hadoop build times in half (Job Eagles via bobby)
|
||||
|
||||
HADOOP-8110. Fix trash checkpoint collisions (Jason Lowe via daryn)
|
||||
|
||||
HADOOP-8525. Provide Improved Traceability for Configuration (bobby)
|
||||
|
||||
HADOOP-8619. WritableComparator must implement no-arg constructor.
|
||||
(Chris Douglas via Suresh)
|
||||
|
||||
OPTIMIZATIONS
|
||||
|
||||
BUG FIXES
|
||||
|
|
@ -890,8 +1080,10 @@ Release 0.23.3 - UNRELEASED
|
|||
|
||||
Release 0.23.2 - UNRELEASED
|
||||
|
||||
NEW FEATURES
|
||||
INCOMPATIBLE CHANGES
|
||||
|
||||
NEW FEATURES
|
||||
|
||||
IMPROVEMENTS
|
||||
|
||||
HADOOP-8048. Allow merging of Credentials (Daryn Sharp via tgraves)
|
||||
|
|
@ -906,7 +1098,6 @@ Release 0.23.2 - UNRELEASED
|
|||
acmurthy)
|
||||
|
||||
OPTIMIZATIONS
|
||||
|
||||
HADOOP-8071. Avoid an extra packet in client code when nagling is
|
||||
disabled. (todd)
|
||||
|
||||
|
|
@ -988,7 +1179,7 @@ Release 0.23.1 - 2012-02-17
|
|||
|
||||
INCOMPATIBLE CHANGES
|
||||
|
||||
NEW FEATURES
|
||||
NEW FEATURES
|
||||
|
||||
HADOOP-7777 Implement a base class for DNSToSwitchMapping implementations
|
||||
that can offer extra topology information. (stevel)
|
||||
|
|
@ -997,18 +1188,14 @@ Release 0.23.1 - 2012-02-17
|
|||
|
||||
HADOOP-7910. Add Configuration.getLongBytes to handle human readable byte size values. (Sho Shimauchi via harsh)
|
||||
|
||||
IMPROVEMENTS
|
||||
|
||||
HADOOP-8015. ChRootFileSystem should extend FilterFileSystem
|
||||
(Daryn Sharp via bobby)
|
||||
IMPROVEMENTS
|
||||
|
||||
HADOOP-7801. HADOOP_PREFIX cannot be overriden. (Bruno Mahé via tomwhite)
|
||||
|
||||
HADOOP-7802. Hadoop scripts unconditionally source
|
||||
"$bin"/../libexec/hadoop-config.sh. (Bruno Mahé via tomwhite)
|
||||
|
||||
HADOOP-7590. Mavenize streaming and MR examples. (tucu)
|
||||
|
||||
HADOOP-7858. Drop some info logging to DEBUG level in IPC,
|
||||
metrics, and HTTP. (todd via eli)
|
||||
|
||||
|
|
@ -1027,8 +1214,6 @@ Release 0.23.1 - 2012-02-17
|
|||
HADOOP-6886. LocalFileSystem Needs createNonRecursive API.
|
||||
(Nicolas Spiegelberg and eli via eli)
|
||||
|
||||
HADOOP-7758. Make GlobFilter class public. (tucu)
|
||||
|
||||
HADOOP-7912. test-patch should run eclipse:eclipse to verify that it does
|
||||
not break again. (Robert Joseph Evans via tomwhite)
|
||||
|
||||
|
|
@ -1040,9 +1225,14 @@ Release 0.23.1 - 2012-02-17
|
|||
HADOOP-7933. Add a getDelegationTokens api to FileSystem which checks
|
||||
for known tokens in the passed Credentials object. (sseth)
|
||||
|
||||
HADOOP-7808. Port HADOOP-7510 - Add configurable option to use original
|
||||
hostname in token instead of IP to allow server IP change.
|
||||
(Daryn Sharp via suresh)
|
||||
HADOOP-7737. normalize hadoop-mapreduce & hadoop-dist dist/tar build with
|
||||
common/hdfs. (tucu)
|
||||
|
||||
HADOOP-7743. Add Maven profile to create a full source tarball. (tucu)
|
||||
|
||||
HADOOP-7758. Make GlobFilter class public. (tucu)
|
||||
|
||||
HADOOP-7590. Mavenize streaming and MR examples. (tucu)
|
||||
|
||||
HADOOP-7934. Normalize dependencies versions across all modules. (tucu)
|
||||
|
||||
|
|
@ -1051,8 +1241,6 @@ Release 0.23.1 - 2012-02-17
|
|||
|
||||
HADOOP-7975. Add LZ4 as an entry in the default codec list, missed by HADOOP-7657 (harsh)
|
||||
|
||||
HADOOP-7987. Support setting the run-as user in unsecure mode. (jitendra)
|
||||
|
||||
HADOOP-4515. Configuration#getBoolean must not be case sensitive. (Sho Shimauchi via harsh)
|
||||
|
||||
HADOOP-6490. Use StringUtils over String#replace in Path#normalizePath.
|
||||
|
|
@ -1068,9 +1256,6 @@ Release 0.23.1 - 2012-02-17
|
|||
|
||||
HADOOP-7939. Improve Hadoop subcomponent integration in Hadoop 0.23. (rvs via tucu)
|
||||
|
||||
HADOOP-7988. Upper case in hostname part of the principals doesn't work with
|
||||
kerberos. (jitendra)
|
||||
|
||||
HADOOP-8002. SecurityUtil acquired token message should be a debug rather than info.
|
||||
(Arpit Gupta via mahadev)
|
||||
|
||||
|
|
@ -1079,30 +1264,13 @@ Release 0.23.1 - 2012-02-17
|
|||
|
||||
HADOOP-7470. Move up to Jackson 1.8.8. (Enis Soztutar via szetszwo)
|
||||
|
||||
HADOOP-7729. Send back valid HTTP response if user hits IPC port with
|
||||
HTTP GET. (todd)
|
||||
|
||||
HADOOP-8027. Visiting /jmx on the daemon web interfaces may print
|
||||
unnecessary error in logs. (atm)
|
||||
|
||||
OPTIMIZATIONS
|
||||
|
||||
HADOOP-7761. Improve the performance of raw comparisons. (todd)
|
||||
|
||||
BUG FIXES
|
||||
|
||||
HADOOP-8018. Hudson auto test for HDFS has started throwing javadoc
|
||||
(Jon Eagles via bobby)
|
||||
|
||||
HADOOP-8001 ChecksumFileSystem's rename doesn't correctly handle checksum
|
||||
files. (Daryn Sharp via bobby)
|
||||
|
||||
HADOOP-8006 TestFSInputChecker is failing in trunk.
|
||||
(Daryn Sharp via bobby)
|
||||
|
||||
HADOOP-7998. CheckFileSystem does not correctly honor setVerifyChecksum
|
||||
(Daryn Sharp via bobby)
|
||||
|
||||
|
||||
HADOOP-7811. TestUserGroupInformation#testGetServerSideGroups test fails in chroot.
|
||||
(Jonathan Eagles via mahadev)
|
||||
|
||||
|
|
@ -1120,45 +1288,24 @@ Release 0.23.1 - 2012-02-17
|
|||
HADOOP-6614. RunJar should provide more diags when it can't create
|
||||
a temp file. (Jonathan Hsieh via eli)
|
||||
|
||||
HADOOP-7843. compilation failing because workDir not initialized in
|
||||
RunJar.java (John George via mahadev)
|
||||
|
||||
HADOOP-7859. TestViewFsHdfs.testgetFileLinkStatus is failing an assert. (eli)
|
||||
|
||||
MAPREDUCE-3465. Fixed project pom to create test dirs (and fix failing tests).
|
||||
(Hitesh Shah via sseth)
|
||||
|
||||
HADOOP-7864. Building mvn site with Maven < 3.0.2 causes OOM errors.
|
||||
(Andrew Bayer via eli)
|
||||
|
||||
HADOOP-7853. multiple javax security configurations cause conflicts.
|
||||
(daryn via tucu)
|
||||
|
||||
HADOOP-7854. UGI getCurrentUser is not synchronized. (Daryn Sharp via jitendra)
|
||||
|
||||
HADOOP-7874. native libs should be under lib/native/ dir. (tucu)
|
||||
|
||||
HADOOP-7887. KerberosAuthenticatorHandler is not setting KerberosName
|
||||
name rules from configuration. (tucu)
|
||||
|
||||
HADOOP-7870. fix SequenceFile#createWriter with boolean
|
||||
createParent arg to respect createParent. (Jon Hsieh via eli)
|
||||
|
||||
HADOOP-7902. skipping name rules setting (if already set) should be done
|
||||
on UGI initialization only. (tucu)
|
||||
HADOOP-7898. Fix javadoc warnings in AuthenticationToken.java. (suresh)
|
||||
|
||||
HADOOP-7898. Fix javadoc warnings in AuthenticationToken.java. (suresh)
|
||||
|
||||
HADOOP-7878 Regression: HADOOP-7777 switch changes break HDFS tests when the
|
||||
isSingleSwitch() predicate is used. (stevel)
|
||||
HADOOP-7878 Regression: HADOOP-7777 switch changes break HDFS tests when the
|
||||
isSingleSwitch() predicate is used. (stevel)
|
||||
|
||||
HADOOP-7914. Remove the duplicated declaration of hadoop-hdfs test-jar in
|
||||
hadoop-project/pom.xml. (szetszwo)
|
||||
|
||||
HADOOP-7810 move hadoop archive to core from tools. (tucu)
|
||||
|
||||
HADOOP_7917. compilation of protobuf files fails in windows/cygwin. (tucu)
|
||||
|
||||
HADOOP-7837. no NullAppender in the log4j config. (eli)
|
||||
|
||||
HADOOP-7948. Shell scripts created by hadoop-dist/pom.xml to build tar do not
|
||||
|
|
@ -1167,6 +1314,23 @@ Release 0.23.1 - 2012-02-17
|
|||
HADOOP-7949. Updated maxIdleTime default in the code to match
|
||||
core-default.xml (eli)
|
||||
|
||||
HADOOP-7853. multiple javax security configurations cause conflicts.
|
||||
(daryn via tucu)
|
||||
|
||||
HDFS-2614. hadoop dist tarball is missing hdfs headers. (tucu)
|
||||
|
||||
HADOOP-7874. native libs should be under lib/native/ dir. (tucu)
|
||||
|
||||
HADOOP-7887. KerberosAuthenticatorHandler is not setting
|
||||
KerberosName name rules from configuration. (tucu)
|
||||
|
||||
HADOOP-7902. skipping name rules setting (if already set) should be done
|
||||
on UGI initialization only. (tucu)
|
||||
|
||||
HADOOP-7810. move hadoop archive to core from tools. (tucu)
|
||||
|
||||
HADOOP_7917. compilation of protobuf files fails in windows/cygwin. (tucu)
|
||||
|
||||
HADOOP-7907. hadoop-tools JARs are not part of the distro. (tucu)
|
||||
|
||||
HADOOP-7936. There's a Hoop README in the root dir of the tarball. (tucu)
|
||||
|
|
@ -1280,9 +1444,6 @@ Release 0.23.0 - 2011-11-01
|
|||
|
||||
IMPROVEMENTS
|
||||
|
||||
HADOOP-7728. Enable task memory management to be configurable in hadoop
|
||||
config setup script. (ramya)
|
||||
|
||||
HADOOP-7655. Provide a small validation script that smoke tests the installed
|
||||
cluster. (Arpit Gupta via mattf)
|
||||
|
||||
|
|
@ -1565,11 +1726,6 @@ Release 0.23.0 - 2011-11-01
|
|||
|
||||
HADOOP-7594. Support HTTP REST in HttpServer. (szetszwo)
|
||||
|
||||
HADOOP-7595. Upgrade dependency to Avro 1.5.3. (Alejandro Abdelnur via atm)
|
||||
|
||||
HADOOP-7604. Hadoop Auth examples pom in 0.23 point to 0.24 versions.
|
||||
(mahadev)
|
||||
|
||||
HADOOP-7552. FileUtil#fullyDelete doesn't throw IOE but lists it
|
||||
in the throws clause. (eli)
|
||||
|
||||
|
|
@ -1595,7 +1751,7 @@ Release 0.23.0 - 2011-11-01
|
|||
HADOOP-7469 Add a standard handler for socket connection problems which
|
||||
improves diagnostics (Uma Maheswara Rao G and stevel via stevel)
|
||||
|
||||
HADOOP-7710. Added hadoop-setup-application.sh for creating
|
||||
HADOOP-7710. Added hadoop-setup-application.sh for creating
|
||||
application directory (Arpit Gupta via Eric Yang)
|
||||
|
||||
HADOOP-7707. Added toggle for dfs.support.append, webhdfs and hadoop proxy
|
||||
|
|
@ -1604,12 +1760,14 @@ Release 0.23.0 - 2011-11-01
|
|||
HADOOP-7720. Added parameter for HBase user to setup config script.
|
||||
(Arpit Gupta via Eric Yang)
|
||||
|
||||
HADOOP-7724. Fixed hadoop-setup-conf.sh to put proxy user in
|
||||
core-site.xml. (Arpit Gupta via Eric Yang)
|
||||
HADOOP-7624. Set things up for a top level hadoop-tools module. (tucu)
|
||||
|
||||
HADOOP-7627. Improve MetricsAsserts to give more understandable output
|
||||
on failure. (todd)
|
||||
|
||||
HADOOP-7642. create hadoop-dist module where TAR stitching would happen.
|
||||
(Thomas White via tucu)
|
||||
|
||||
HADOOP-7709. Running a set of methods in a Single Test Class.
|
||||
(Jonathan Eagles via mahadev)
|
||||
|
||||
|
|
@ -1620,7 +1778,7 @@ Release 0.23.0 - 2011-11-01
|
|||
help in exception messages. (todd)
|
||||
|
||||
HADOOP-7762. Common side of MR-2736. (eli)
|
||||
|
||||
|
||||
HADOOP-7668. Add a NetUtils method that can tell if an InetAddress
|
||||
belongs to local host. (suresh)
|
||||
|
||||
|
|
@ -1635,16 +1793,6 @@ Release 0.23.0 - 2011-11-01
|
|||
HADOOP-7360. Preserve relative paths that do not contain globs in FsShell.
|
||||
(Daryn Sharp and Kihwal Lee via szetszwo)
|
||||
|
||||
HADOOP-7624. Set things up for a top level hadoop-tools module. (tucu)
|
||||
|
||||
HADOOP-7642. create hadoop-dist module where TAR stitching would happen.
|
||||
(Thomas White via tucu)
|
||||
|
||||
HADOOP-7737. normalize hadoop-mapreduce & hadoop-dist dist/tar build with
|
||||
common/hdfs. (tucu)
|
||||
|
||||
HADOOP-7743. Add Maven profile to create a full source tarball. (tucu)
|
||||
|
||||
HADOOP-7771. FsShell -copyToLocal, -get, etc. commands throw NPE if the
|
||||
destination directory does not exist. (John George and Daryn Sharp
|
||||
via szetszwo)
|
||||
|
|
@ -1653,9 +1801,6 @@ Release 0.23.0 - 2011-11-01
|
|||
|
||||
HADOOP-7789. Improvements to site navigation. (acmurthy)
|
||||
|
||||
HADOOP-7792. Add verifyToken method to AbstractDelegationTokenSecretManager.
|
||||
(jitendra)
|
||||
|
||||
OPTIMIZATIONS
|
||||
|
||||
HADOOP-7333. Performance improvement in PureJavaCrc32. (Eric Caspole
|
||||
|
|
@ -1863,9 +2008,6 @@ Release 0.23.0 - 2011-11-01
|
|||
HADOOP-7593. Fix AssertionError in TestHttpServer.testMaxThreads().
|
||||
(Uma Maheswara Rao G via szetszwo)
|
||||
|
||||
HADOOP-7606. Upgrade Jackson to version 1.7.1 to match the version required
|
||||
by Jersey (Alejandro Abdelnur via atm)
|
||||
|
||||
HADOOP-7598. Fix smart-apply-patch.sh to handle patching from a sub
|
||||
directory correctly. (Robert Evans via acmurthy)
|
||||
|
||||
|
|
@ -1888,10 +2030,6 @@ Release 0.23.0 - 2011-11-01
|
|||
|
||||
HADOOP-7631. Fixes a config problem to do with running streaming jobs
|
||||
(Eric Yang via ddas)
|
||||
|
||||
HADOOP-7671 Add license headers to
|
||||
hadoop-common/src/main/packages/templates/conf/
|
||||
(Ravi Prakash via stevel)
|
||||
|
||||
HADOOP-7662. Fixed logs servlet to use the pathspec '/*' instead of '/'
|
||||
for correct filtering. (Thomas Graves via vinodkv)
|
||||
|
|
@ -1918,9 +2056,12 @@ Release 0.23.0 - 2011-11-01
|
|||
HADOOP-7681. Fixed security and hdfs audit log4j properties
|
||||
(Arpit Gupta via Eric Yang)
|
||||
|
||||
HADOOP-7708. Fixed hadoop-setup-conf.sh to handle config file
|
||||
HADOOP-7708. Fixed hadoop-setup-conf.sh to handle config files
|
||||
consistently. (Eric Yang)
|
||||
|
||||
HADOOP-7724. Fixed hadoop-setup-conf.sh to put proxy user in
|
||||
core-site.xml. (Arpit Gupta via Eric Yang)
|
||||
|
||||
HADOOP-7755. Detect MapReduce PreCommit Trunk builds silently failing
|
||||
when running test-patch.sh. (Jonathan Eagles via tomwhite)
|
||||
|
||||
|
|
@ -1928,18 +2069,16 @@ Release 0.23.0 - 2011-11-01
|
|||
Eagles via acmurthy)
|
||||
|
||||
HADOOP-7764. Allow HttpServer to set both ACL list and path spec filters.
|
||||
(Jonathan Eagles via acmurthy)
|
||||
(Jonathan Eagles via acmurthy)
|
||||
|
||||
HADOOP-7766. The auth to local mappings are not being respected, with webhdfs
|
||||
and security enabled. (jitendra)
|
||||
|
||||
HADOOP-7721. Add log before login in KerberosAuthenticationHandler. (jitendra)
|
||||
HADOOP-7721. Add log before login in KerberosAuthenticationHandler.
|
||||
(jitendra)
|
||||
|
||||
HADOOP-7778. FindBugs warning in Token.getKind(). (tomwhite)
|
||||
|
||||
HADOOP-7770. ViewFS getFileChecksum throws FileNotFoundException for files in
|
||||
/tmp and /user. (Ravi Prakash via jitendra)
|
||||
|
||||
HADOOP-7798. Add support gpg signatures for maven release artifacts.
|
||||
(cutting via acmurthy)
|
||||
|
||||
|
|
@ -2217,8 +2356,8 @@ Release 0.22.0 - 2011-11-29
|
|||
|
||||
HADOOP-7786. Remove HDFS-specific config keys defined in FsConfig. (eli)
|
||||
|
||||
HADOOP-7358. Improve log levels when exceptions caught in RPC handler
|
||||
(Todd Lipcon via shv)
|
||||
HADOOP-7861. changes2html.pl generates links to HADOOP, HDFS, and MAPREDUCE
|
||||
jiras. (shv)
|
||||
|
||||
OPTIMIZATIONS
|
||||
|
||||
|
|
|
|||
|
|
@ -2297,4 +2297,14 @@ public class Configuration implements Iterable<Map.Entry<String,String>>,
|
|||
* for getClassByName. {@see Configuration#getClassByNameOrNull(String)}
|
||||
*/
|
||||
private static abstract class NegativeCacheSentinel {}
|
||||
|
||||
public static void dumpDeprecatedKeys() {
|
||||
for (Map.Entry<String, DeprecatedKeyInfo> entry : deprecatedKeyMap.entrySet()) {
|
||||
String newKeys = "";
|
||||
for (String newKey : entry.getValue().newKeys) {
|
||||
newKeys += newKey + "\t";
|
||||
}
|
||||
System.out.println(entry.getKey() + "\t" + newKeys);
|
||||
}
|
||||
}
|
||||
}
|
||||
|
|
|
|||
|
|
@ -24,8 +24,6 @@ Deprecated Properties
|
|||
*-------------------------------+-----------------------+
|
||||
|| <<Deprecated property name>> || <<New property name>>|
|
||||
*-------------------------------+-----------------------+
|
||||
|StorageId | dfs.datanode.StorageId
|
||||
*---+---+
|
||||
|create.empty.dir.if.nonexist | mapreduce.jobcontrol.createdir.ifnotexist
|
||||
*---+---+
|
||||
|dfs.access.time.precision | dfs.namenode.accesstime.precision
|
||||
|
|
@ -38,14 +36,16 @@ Deprecated Properties
|
|||
*---+---+
|
||||
|dfs.block.size | dfs.blocksize
|
||||
*---+---+
|
||||
|dfs.client.buffer.dir | fs.client.buffer.dir
|
||||
*---+---+
|
||||
|dfs.data.dir | dfs.datanode.data.dir
|
||||
*---+---+
|
||||
|dfs.datanode.max.xcievers | dfs.datanode.max.transfer.threads
|
||||
*---+---+
|
||||
|dfs.df.interval | fs.df.interval
|
||||
*---+---+
|
||||
|dfs.federation.nameservice.id | dfs.nameservice.id
|
||||
*---+---+
|
||||
|dfs.federation.nameservices | dfs.nameservices
|
||||
*---+---+
|
||||
|dfs.http.address | dfs.namenode.http-address
|
||||
*---+---+
|
||||
|dfs.https.address | dfs.namenode.https-address
|
||||
|
|
@ -54,10 +54,10 @@ Deprecated Properties
|
|||
*---+---+
|
||||
|dfs.https.need.client.auth | dfs.client.https.need-auth
|
||||
*---+---+
|
||||
|dfs.max-repl-streams | dfs.namenode.replication.max-streams
|
||||
*---+---+
|
||||
|dfs.max.objects | dfs.namenode.max.objects
|
||||
*---+---+
|
||||
|dfs.max-repl-streams | dfs.namenode.replication.max-streams
|
||||
*---+---+
|
||||
|dfs.name.dir | dfs.namenode.name.dir
|
||||
*---+---+
|
||||
|dfs.name.dir.restore | dfs.namenode.name.dir.restore
|
||||
|
|
@ -86,7 +86,7 @@ Deprecated Properties
|
|||
*---+---+
|
||||
|dfs.socket.timeout | dfs.client.socket-timeout
|
||||
*---+---+
|
||||
|dfs.upgrade.permission | dfs.namenode.upgrade.permission
|
||||
|dfs.umaskmode | fs.permissions.umask-mode
|
||||
*---+---+
|
||||
|dfs.write.packet.size | dfs.client-write-packet-size
|
||||
*---+---+
|
||||
|
|
@ -108,10 +108,10 @@ Deprecated Properties
|
|||
*---+---+
|
||||
|hadoop.pipes.command-file.keep | mapreduce.pipes.commandfile.preserve
|
||||
*---+---+
|
||||
|hadoop.pipes.executable | mapreduce.pipes.executable
|
||||
*---+---+
|
||||
|hadoop.pipes.executable.interpretor | mapreduce.pipes.executable.interpretor
|
||||
*---+---+
|
||||
|hadoop.pipes.executable | mapreduce.pipes.executable
|
||||
*---+---+
|
||||
|hadoop.pipes.java.mapper | mapreduce.pipes.isjavamapper
|
||||
*---+---+
|
||||
|hadoop.pipes.java.recordreader | mapreduce.pipes.isjavarecordreader
|
||||
|
|
@ -132,6 +132,12 @@ Deprecated Properties
|
|||
*---+---+
|
||||
|io.sort.spill.percent | mapreduce.map.sort.spill.percent
|
||||
*---+---+
|
||||
|jobclient.completion.poll.interval | mapreduce.client.completion.pollinterval
|
||||
*---+---+
|
||||
|jobclient.output.filter | mapreduce.client.output.filter
|
||||
*---+---+
|
||||
|jobclient.progress.monitor.poll.interval | mapreduce.client.progressmonitor.pollinterval
|
||||
*---+---+
|
||||
|job.end.notification.url | mapreduce.job.end-notification.url
|
||||
*---+---+
|
||||
|job.end.retry.attempts | mapreduce.job.end-notification.retry.attempts
|
||||
|
|
@ -140,12 +146,6 @@ Deprecated Properties
|
|||
*---+---+
|
||||
|job.local.dir | mapreduce.job.local.dir
|
||||
*---+---+
|
||||
|jobclient.completion.poll.interval | mapreduce.client.completion.pollinterval
|
||||
*---+---+
|
||||
|jobclient.output.filter | mapreduce.client.output.filter
|
||||
*---+---+
|
||||
|jobclient.progress.monitor.poll.interval | mapreduce.client.progressmonitor.pollinterval
|
||||
*---+---+
|
||||
|keep.failed.task.files | mapreduce.task.files.preserve.failedtasks
|
||||
*---+---+
|
||||
|keep.task.files.pattern | mapreduce.task.files.preserve.filepattern
|
||||
|
|
@ -198,10 +198,6 @@ Deprecated Properties
|
|||
*---+---+
|
||||
|mapred.compress.map.output | mapreduce.map.output.compress
|
||||
*---+---+
|
||||
|mapred.create.symlink | NONE - symlinking is always on
|
||||
*---+---+
|
||||
|mapreduce.job.cache.symlink.create | NONE - symlinking is always on
|
||||
*---+---+
|
||||
|mapred.data.field.separator | mapreduce.fieldsel.data.field.separator
|
||||
*---+---+
|
||||
|mapred.debug.out.lines | mapreduce.task.debugout.lines
|
||||
|
|
@ -216,18 +212,18 @@ Deprecated Properties
|
|||
*---+---+
|
||||
|mapred.heartbeats.in.second | mapreduce.jobtracker.heartbeats.in.second
|
||||
*---+---+
|
||||
|mapred.hosts | mapreduce.jobtracker.hosts.filename
|
||||
*---+---+
|
||||
|mapred.hosts.exclude | mapreduce.jobtracker.hosts.exclude.filename
|
||||
*---+---+
|
||||
|mapred.inmem.merge.threshold | mapreduce.reduce.merge.inmem.threshold
|
||||
|mapred.hosts | mapreduce.jobtracker.hosts.filename
|
||||
*---+---+
|
||||
|mapred.input.dir | mapreduce.input.fileinputformat.inputdir
|
||||
|mapred.inmem.merge.threshold | mapreduce.reduce.merge.inmem.threshold
|
||||
*---+---+
|
||||
|mapred.input.dir.formats | mapreduce.input.multipleinputs.dir.formats
|
||||
*---+---+
|
||||
|mapred.input.dir.mappers | mapreduce.input.multipleinputs.dir.mappers
|
||||
*---+---+
|
||||
|mapred.input.dir | mapreduce.input.fileinputformat.inputdir
|
||||
*---+---+
|
||||
|mapred.input.pathFilter.class | mapreduce.input.pathFilter.class
|
||||
*---+---+
|
||||
|mapred.jar | mapreduce.job.jar
|
||||
|
|
@ -238,6 +234,8 @@ Deprecated Properties
|
|||
*---+---+
|
||||
|mapred.job.id | mapreduce.job.id
|
||||
*---+---+
|
||||
|mapred.jobinit.threads | mapreduce.jobtracker.jobinit.threads
|
||||
*---+---+
|
||||
|mapred.job.map.memory.mb | mapreduce.map.memory.mb
|
||||
*---+---+
|
||||
|mapred.job.name | mapreduce.job.name
|
||||
|
|
@ -260,42 +258,40 @@ Deprecated Properties
|
|||
*---+---+
|
||||
|mapred.job.shuffle.merge.percent | mapreduce.reduce.shuffle.merge.percent
|
||||
*---+---+
|
||||
|mapred.job.tracker | mapreduce.jobtracker.address
|
||||
*---+---+
|
||||
|mapred.job.tracker.handler.count | mapreduce.jobtracker.handler.count
|
||||
*---+---+
|
||||
|mapred.job.tracker.history.completed.location | mapreduce.jobtracker.jobhistory.completed.location
|
||||
*---+---+
|
||||
|mapred.job.tracker.http.address | mapreduce.jobtracker.http.address
|
||||
*---+---+
|
||||
|mapred.jobtracker.instrumentation | mapreduce.jobtracker.instrumentation
|
||||
*---+---+
|
||||
|mapred.jobtracker.job.history.block.size | mapreduce.jobtracker.jobhistory.block.size
|
||||
*---+---+
|
||||
|mapred.job.tracker.jobhistory.lru.cache.size | mapreduce.jobtracker.jobhistory.lru.cache.size
|
||||
*---+---+
|
||||
|mapred.job.tracker | mapreduce.jobtracker.address
|
||||
*---+---+
|
||||
|mapred.jobtracker.maxtasks.per.job | mapreduce.jobtracker.maxtasks.perjob
|
||||
*---+---+
|
||||
|mapred.job.tracker.persist.jobstatus.active | mapreduce.jobtracker.persist.jobstatus.active
|
||||
*---+---+
|
||||
|mapred.job.tracker.persist.jobstatus.dir | mapreduce.jobtracker.persist.jobstatus.dir
|
||||
*---+---+
|
||||
|mapred.job.tracker.persist.jobstatus.hours | mapreduce.jobtracker.persist.jobstatus.hours
|
||||
*---+---+
|
||||
|mapred.job.tracker.retire.jobs | mapreduce.jobtracker.retirejobs
|
||||
|mapred.jobtracker.restart.recover | mapreduce.jobtracker.restart.recover
|
||||
*---+---+
|
||||
|mapred.job.tracker.retiredjobs.cache.size | mapreduce.jobtracker.retiredjobs.cache.size
|
||||
*---+---+
|
||||
|mapred.jobinit.threads | mapreduce.jobtracker.jobinit.threads
|
||||
|mapred.job.tracker.retire.jobs | mapreduce.jobtracker.retirejobs
|
||||
*---+---+
|
||||
|mapred.jobtracker.instrumentation | mapreduce.jobtracker.instrumentation
|
||||
*---+---+
|
||||
|mapred.jobtracker.job.history.block.size | mapreduce.jobtracker.jobhistory.block.size
|
||||
*---+---+
|
||||
|mapred.jobtracker.maxtasks.per.job | mapreduce.jobtracker.maxtasks.perjob
|
||||
*---+---+
|
||||
|mapred.jobtracker.restart.recover | mapreduce.jobtracker.restart.recover
|
||||
|mapred.jobtracker.taskalloc.capacitypad | mapreduce.jobtracker.taskscheduler.taskalloc.capacitypad
|
||||
*---+---+
|
||||
|mapred.jobtracker.taskScheduler | mapreduce.jobtracker.taskscheduler
|
||||
*---+---+
|
||||
|mapred.jobtracker.taskScheduler.maxRunningTasksPerJob | mapreduce.jobtracker.taskscheduler.maxrunningtasks.perjob
|
||||
*---+---+
|
||||
|mapred.jobtracker.taskalloc.capacitypad | mapreduce.jobtracker.taskscheduler.taskalloc.capacitypad
|
||||
*---+---+
|
||||
|mapred.join.expr | mapreduce.join.expr
|
||||
*---+---+
|
||||
|mapred.join.keycomparator | mapreduce.join.keycomparator
|
||||
|
|
@ -322,20 +318,20 @@ Deprecated Properties
|
|||
*---+---+
|
||||
|mapred.map.output.compression.codec | mapreduce.map.output.compress.codec
|
||||
*---+---+
|
||||
|mapred.mapoutput.key.class | mapreduce.map.output.key.class
|
||||
*---+---+
|
||||
|mapred.mapoutput.value.class | mapreduce.map.output.value.class
|
||||
*---+---+
|
||||
|mapred.mapper.regex.group | mapreduce.mapper.regexmapper..group
|
||||
*---+---+
|
||||
|mapred.mapper.regex | mapreduce.mapper.regex
|
||||
*---+---+
|
||||
|mapred.map.task.debug.script | mapreduce.map.debug.script
|
||||
*---+---+
|
||||
|mapred.map.tasks | mapreduce.job.maps
|
||||
*---+---+
|
||||
|mapred.map.tasks.speculative.execution | mapreduce.map.speculative
|
||||
*---+---+
|
||||
|mapred.mapoutput.key.class | mapreduce.map.output.key.class
|
||||
*---+---+
|
||||
|mapred.mapoutput.value.class | mapreduce.map.output.value.class
|
||||
*---+---+
|
||||
|mapred.mapper.regex | mapreduce.mapper.regex
|
||||
*---+---+
|
||||
|mapred.mapper.regex.group | mapreduce.mapper.regexmapper..group
|
||||
*---+---+
|
||||
|mapred.max.map.failures.percent | mapreduce.map.failures.maxpercent
|
||||
*---+---+
|
||||
|mapred.max.reduce.failures.percent | mapreduce.reduce.failures.maxpercent
|
||||
|
|
@ -354,12 +350,12 @@ Deprecated Properties
|
|||
*---+---+
|
||||
|mapred.min.split.size.per.rack | mapreduce.input.fileinputformat.split.minsize.per.rack
|
||||
*---+---+
|
||||
|mapred.output.compress | mapreduce.output.fileoutputformat.compress
|
||||
*---+---+
|
||||
|mapred.output.compression.codec | mapreduce.output.fileoutputformat.compress.codec
|
||||
*---+---+
|
||||
|mapred.output.compression.type | mapreduce.output.fileoutputformat.compress.type
|
||||
*---+---+
|
||||
|mapred.output.compress | mapreduce.output.fileoutputformat.compress
|
||||
*---+---+
|
||||
|mapred.output.dir | mapreduce.output.fileoutputformat.outputdir
|
||||
*---+---+
|
||||
|mapred.output.key.class | mapreduce.job.output.key.class
|
||||
|
|
@ -442,12 +438,6 @@ Deprecated Properties
|
|||
*---+---+
|
||||
|mapred.task.timeout | mapreduce.task.timeout
|
||||
*---+---+
|
||||
|mapred.task.tracker.http.address | mapreduce.tasktracker.http.address
|
||||
*---+---+
|
||||
|mapred.task.tracker.report.address | mapreduce.tasktracker.report.address
|
||||
*---+---+
|
||||
|mapred.task.tracker.task-controller | mapreduce.tasktracker.taskcontroller
|
||||
*---+---+
|
||||
|mapred.tasktracker.dns.interface | mapreduce.tasktracker.dns.interface
|
||||
*---+---+
|
||||
|mapred.tasktracker.dns.nameserver | mapreduce.tasktracker.dns.nameserver
|
||||
|
|
@ -456,6 +446,8 @@ Deprecated Properties
|
|||
*---+---+
|
||||
|mapred.tasktracker.expiry.interval | mapreduce.jobtracker.expire.trackers.interval
|
||||
*---+---+
|
||||
|mapred.task.tracker.http.address | mapreduce.tasktracker.http.address
|
||||
*---+---+
|
||||
|mapred.tasktracker.indexcache.mb | mapreduce.tasktracker.indexcache.mb
|
||||
*---+---+
|
||||
|mapred.tasktracker.instrumentation | mapreduce.tasktracker.instrumentation
|
||||
|
|
@ -468,6 +460,10 @@ Deprecated Properties
|
|||
*---+---+
|
||||
|mapred.tasktracker.reduce.tasks.maximum | mapreduce.tasktracker.reduce.tasks.maximum
|
||||
*---+---+
|
||||
|mapred.task.tracker.report.address | mapreduce.tasktracker.report.address
|
||||
*---+---+
|
||||
|mapred.task.tracker.task-controller | mapreduce.tasktracker.taskcontroller
|
||||
*---+---+
|
||||
|mapred.tasktracker.taskmemorymanager.monitoring-interval | mapreduce.tasktracker.taskmemorymanager.monitoringinterval
|
||||
*---+---+
|
||||
|mapred.tasktracker.tasks.sleeptime-before-sigkill | mapreduce.tasktracker.tasks.sleeptimebeforesigkill
|
||||
|
|
@ -482,20 +478,12 @@ Deprecated Properties
|
|||
*---+---+
|
||||
|mapred.tip.id | mapreduce.task.id
|
||||
*---+---+
|
||||
|mapred.used.genericoptionsparser | mapreduce.client.genericoptionsparser.used
|
||||
*---+---+
|
||||
|mapred.userlog.limit.kb | mapreduce.task.userlog.limit.kb
|
||||
*---+---+
|
||||
|mapred.userlog.retain.hours | mapreduce.job.userlog.retain.hours
|
||||
*---+---+
|
||||
|mapred.work.output.dir | mapreduce.task.output.dir
|
||||
*---+---+
|
||||
|mapred.working.dir | mapreduce.job.working.dir
|
||||
*---+---+
|
||||
|mapreduce.combine.class | mapreduce.job.combine.class
|
||||
*---+---+
|
||||
|mapreduce.inputformat.class | mapreduce.job.inputformat.class
|
||||
*---+---+
|
||||
|mapreduce.job.counters.limit | mapreduce.job.counters.max
|
||||
*---+---+
|
||||
|mapreduce.jobtracker.permissions.supergroup | mapreduce.cluster.permissions.supergroup
|
||||
*---+---+
|
||||
|mapreduce.map.class | mapreduce.job.map.class
|
||||
|
|
@ -506,6 +494,16 @@ Deprecated Properties
|
|||
*---+---+
|
||||
|mapreduce.reduce.class | mapreduce.job.reduce.class
|
||||
*---+---+
|
||||
|mapred.used.genericoptionsparser | mapreduce.client.genericoptionsparser.used
|
||||
*---+---+
|
||||
|mapred.userlog.limit.kb | mapreduce.task.userlog.limit.kb
|
||||
*---+---+
|
||||
|mapred.userlog.retain.hours | mapreduce.job.userlog.retain.hours
|
||||
*---+---+
|
||||
|mapred.working.dir | mapreduce.job.working.dir
|
||||
*---+---+
|
||||
|mapred.work.output.dir | mapreduce.task.output.dir
|
||||
*---+---+
|
||||
|min.num.spills.for.combine | mapreduce.map.combine.minspills
|
||||
*---+---+
|
||||
|reduce.output.key.value.fields.spec | mapreduce.fieldsel.reduce.output.key.value.fields.spec
|
||||
|
|
@ -539,4 +537,14 @@ Deprecated Properties
|
|||
|user.name | mapreduce.job.user.name
|
||||
*---+---+
|
||||
|webinterface.private.actions | mapreduce.jobtracker.webinterface.trusted
|
||||
*---+---+
|
||||
|
||||
The following table lists additional changes to some configuration properties:
|
||||
|
||||
*-------------------------------+-----------------------+
|
||||
|| <<Deprecated property name>> || <<New property name>>|
|
||||
*-------------------------------+-----------------------+
|
||||
|mapred.create.symlink | NONE - symlinking is always on
|
||||
*---+---+
|
||||
|mapreduce.job.cache.symlink.create | NONE - symlinking is always on
|
||||
*---+---+
|
||||
|
|
|
|||
|
|
@ -105,4 +105,9 @@ public class HdfsConfiguration extends Configuration {
|
|||
deprecate("dfs.federation.nameservices", DFSConfigKeys.DFS_NAMESERVICES);
|
||||
deprecate("dfs.federation.nameservice.id", DFSConfigKeys.DFS_NAMESERVICE_ID);
|
||||
}
|
||||
|
||||
public static void main(String[] args) {
|
||||
init();
|
||||
Configuration.dumpDeprecatedKeys();
|
||||
}
|
||||
}
|
||||
|
|
|
|||
|
|
@ -520,5 +520,10 @@ public class ConfigUtil {
|
|||
MRJobConfig.MR_AM_SECURITY_SERVICE_AUTHORIZATION_CLIENT
|
||||
});
|
||||
}
|
||||
|
||||
public static void main(String[] args) {
|
||||
loadResources();
|
||||
Configuration.dumpDeprecatedKeys();
|
||||
}
|
||||
}
|
||||
|
||||
|
|
|
|||
Loading…
Reference in New Issue