diff --git a/hadoop-common-project/hadoop-common/CHANGES.txt b/hadoop-common-project/hadoop-common/CHANGES.txt index e0f100401a4..2e13b227c93 100644 --- a/hadoop-common-project/hadoop-common/CHANGES.txt +++ b/hadoop-common-project/hadoop-common/CHANGES.txt @@ -1,7 +1,219 @@ Hadoop Change Log -Release 2.0.3-alpha - Unreleased - +Trunk (Unreleased) + + INCOMPATIBLE CHANGES + + HADOOP-8124. Remove the deprecated FSDataOutputStream constructor, + FSDataOutputStream.sync() and Syncable.sync(). (szetszwo) + + NEW FEATURES + + HADOOP-8469. Make NetworkTopology class pluggable. (Junping Du via + szetszwo) + + HADOOP-8470. Add NetworkTopologyWithNodeGroup, a 4-layer implementation + of NetworkTopology. (Junping Du via szetszwo) + + IMPROVEMENTS + + HADOOP-8017. Configure hadoop-main pom to get rid of M2E plugin execution + not covered (Eric Charles via bobby) + + HADOOP-8015. ChRootFileSystem should extend FilterFileSystem + (Daryn Sharp via bobby) + + HADOOP-7595. Upgrade dependency to Avro 1.5.3. (Alejandro Abdelnur via atm) + + HADOOP-7664. Remove warmings when overriding final parameter configuration + if the override value is same as the final parameter value. + (Ravi Prakash via suresh) + + HADOOP-7729. Send back valid HTTP response if user hits IPC port with + HTTP GET. (todd) + + HADOOP-7792. Add verifyToken method to AbstractDelegationTokenSecretManager. + (jitendra) + + HADOOP-7688. Add servlet handler check in HttpServer.start(). + (Uma Maheswara Rao G via szetszwo) + + HADOOP-7886. Add toString to FileStatus. (SreeHari via jghoman) + + HADOOP-7808. Port HADOOP-7510 - Add configurable option to use original + hostname in token instead of IP to allow server IP change. + (Daryn Sharp via suresh) + + HADOOP-7987. Support setting the run-as user in unsecure mode. (jitendra) + + HADOOP-7988. Upper case in hostname part of the principals doesn't work with + kerberos. (jitendra) + + HADOOP-8078. Add capability to turn on security in unit tests. (Jaimin Jetly + via jitendra) + + HADOOP-7994. Remove getProtocolVersion and getProtocolSignature from the + client side translator and server side implementation. (jitendra) + + HADOOP-7757. Test file reference count is at least 3x actual value (Jon + Eagles via bobby) + + HADOOP-8147. test-patch should run tests with -fn to avoid masking test + failures (Robert Evans via tgraves) + + HADOOP-8290. Remove remaining references to hadoop.native.lib (harsh) + + HADOOP-8308. Support cross-project Jenkins builds. (tomwhite) + + HADOOP-8297. Writable javadocs don't carry default constructor (harsh) + + HADOOP-8360. empty-configuration.xml fails xml validation + (Radim Kolar via harsh) + + HADOOP-8367 Improve documentation of declaringClassProtocolName in rpc headers + (Sanjay Radia) + + HADOOP-8415. Add getDouble() and setDouble() in + org.apache.hadoop.conf.Configuration (Jan van der Lugt via harsh) + + HADOOP-7659. fs -getmerge isn't guaranteed to work well over non-HDFS + filesystems (harsh) + + HADOOP-8059. Add javadoc to InterfaceAudience and InterfaceStability. + (Brandon Li via suresh) + + HADOOP-8434. Add tests for Configuration setter methods. + (Madhukara Phatak via suresh) + + HADOOP-8523. test-patch.sh doesn't validate patches before building + (Jack Dintruff via jeagles) + + HADOOP-8624. ProtobufRpcEngine should log all RPCs if TRACE logging is + enabled (todd) + + HADOOP-8711. IPC Server supports adding exceptions for which + the message is printed and the stack trace is not printed to avoid chatter. + (Brandon Li via Suresh) + + HADOOP-8719. Workaround for kerberos-related log errors upon running any + hadoop command on OSX. (Jianbin Wei via harsh) + + HADOOP-8619. WritableComparator must implement no-arg constructor. + (Chris Douglas via Suresh) + + HADOOP-8736. Add Builder for building RPC server. (Brandon Li via Suresh) + + BUG FIXES + + HADOOP-8177. MBeans shouldn't try to register when it fails to create MBeanName. + (Devaraj K via umamahesh) + + HADOOP-7900. LocalDirAllocator confChanged() accesses conf.get() twice + (Ravi Gummadi via Uma Maheswara Rao G) + + HADOOP-8146. FsShell commands cannot be interrupted + (Daryn Sharp via Uma Maheswara Rao G) + + HADOOP-8018. Hudson auto test for HDFS has started throwing javadoc + (Jon Eagles via bobby) + + HADOOP-8001 ChecksumFileSystem's rename doesn't correctly handle checksum + files. (Daryn Sharp via bobby) + + HADOOP-8006 TestFSInputChecker is failing in trunk. + (Daryn Sharp via bobby) + + HADOOP-7998. CheckFileSystem does not correctly honor setVerifyChecksum + (Daryn Sharp via bobby) + + HADOOP-7606. Upgrade Jackson to version 1.7.1 to match the version required + by Jersey (Alejandro Abdelnur via atm) + + HADOOP-7610. Fix for hadoop debian package (Eric Yang via gkesavan) + + HADOOP-7641. Add Apache License to template config files. + (Eric Yang via atm) + + HADOOP-7621. alfredo config should be in a file not readable by users + (Alejandro Abdelnur via atm) + + HADOOP-7669 Fix newly introduced release audit warning. + (Uma Maheswara Rao G via stevel) + + HADOOP-6220. HttpServer wraps InterruptedExceptions by IOExceptions + if interrupted in startup (stevel) + + HADOOP-7703. Improved exception handling of shutting down web server. + (Devaraj K via Eric Yang) + + HADOOP-7704. Reduce number of object created by JMXJsonServlet. + (Devaraj K via Eric Yang) + + HADOOP-7769. TestJMXJsonServlet is failing. (tomwhite) + + HADOOP-7770. ViewFS getFileChecksum throws FileNotFoundException for files in + /tmp and /user. (Ravi Prakash via jitendra) + + HADOOP-8141. Add method to SecurityUtil to init krb5 cipher suites. + (todd) + + HADOOP-7788. Add simple HealthMonitor class to watch an HAService (todd) + + HADOOP-8312. testpatch.sh should provide a simpler way to see which + warnings changed (bobby) + + HADOOP-8339. jenkins complaining about 16 javadoc warnings + (Tom White and Robert Evans via tgraves) + + HADOOP-8354. test-patch findbugs may fail if a dependent module is changed + (Tom White and Robert Evans) + + HADOOP-8375. test-patch should stop immediately once it has found + compilation errors (bobby) + + HADOOP-8395. Text shell command unnecessarily demands that a + SequenceFile's key class be WritableComparable (harsh) + + HADOOP-8413. test-patch.sh gives out the wrong links for + newPatchFindbugsWarnings (Colin Patrick McCabe via bobby) + + HADOOP-6871. When the value of a configuration key is set to its + unresolved form, it causes the IllegalStateException in + Configuration.get() stating that substitution depth is too large. + (Arvind Prabhakar via harsh) + + HADOOP-8548. test-patch.sh shows an incorrect link in Jekins builds + (Kihwal Lee via bobby) + + HADOOP-8110. Fix trash checkpoint collisions (Jason Lowe via daryn) + + HADOOP-8584. test-patch.sh should not immediately exit when no + tests are added or modified. (Colin Patrick McCabe via eli) + + HADOOP-8521. Port StreamInputFormat to new Map Reduce API (madhukara + phatak via bobby) + + HADOOP-8593. Add missed @Override annotations in Metric/Metrics2 package. + (Brandon Li via suresh) + + HADOOP-8623. hadoop jar command should respect HADOOP_OPTS. + (Steven Willis via suresh) + + HADOOP-8684. Deadlock between WritableComparator and WritableComparable. + (Jing Zhao via suresh) + + HADOOP-8786. HttpServer continues to start even if AuthenticationFilter + fails to init (todd) + + HADOOP-8767. Secondary namenode is started on slave nodes instead of + master nodes. (Giovanni Delussu via suresh) + + OPTIMIZATIONS + + HADOOP-7761. Improve the performance of raw comparisons. (todd) + +Release 2.0.3-alpha - Unreleased + INCOMPATIBLE CHANGES NEW FEATURES @@ -19,16 +231,13 @@ Release 2.0.3-alpha - Unreleased OPTIMIZATIONS - BUG FIXES - - HADOOP-7688. When a servlet filter throws an exception in init(..), the - Jetty server failed silently. (umamahesh) + BUG FIXES HADOOP-8795. BASH tab completion doesn't look in PATH, assumes path to executable is specified. (Sean Mackrory via atm) - HADOOP-8786. HttpServer continues to start even if AuthenticationFilter - fails to init. (Todd Lipcon via umamahesh) + HADOOP-8780. Update DeprecatedProperties apt file. (Ahmed Radwan via + tomwhite) Release 2.0.2-alpha - 2012-09-07 @@ -39,10 +248,10 @@ Release 2.0.2-alpha - 2012-09-07 HADOOP-8689. Make trash a server side configuration option. (eli) - HADOOP-8710. Remove ability for users to easily run the trash emptier. (eli) + HADOOP-8710. Remove ability for users to easily run the trash emptire. (eli) NEW FEATURES - + HDFS-3042. Automatic failover support for NameNode HA (todd) (see dedicated section below for breakdown of subtasks) @@ -77,12 +286,15 @@ Release 2.0.2-alpha - 2012-09-07 HADOOP-8398. Cleanup BlockLocation. (eli) - HADOOP-8403. bump up POMs version to 2.0.1-SNAPSHOT. (tucu) + HADOOP-8422. Deprecate FileSystem#getDefault* and getServerDefault + methods that don't take a Path argument. (eli) HADOOP-8323. Add javadoc and tests for Text.clear() behavior (harsh) HADOOP-8358. Config-related WARN for dfs.web.ugi can be avoided. (harsh) + HADOOP-8450. Remove src/test/system. (eli) + HADOOP-8244. Improve comments on ByteBufferReadable.read. (Henry Robinson via atm) @@ -113,13 +325,22 @@ Release 2.0.2-alpha - 2012-09-07 HADOOP-8541. Better high-percentile latency metrics. (Andrew Wang via atm) - HADOOP-8362. Improve exception message when Configuration.set() is called with a null key or value. (Madhukara Phatak and Suresh Srinivas via harsh) + HADOOP-8362. Improve exception message when Configuration.set() is + called with a null key or value. (Madhukara Phatak + and Suresh Srinivas via harsh) - HADOOP-8624. ProtobufRpcEngine should log all RPCs if TRACE logging is - enabled (todd) + HADOOP-7818. DiskChecker#checkDir should fail if the directory is + not executable. (Madhukara Phatak via harsh) - HADOOP-8623. hadoop jar command should respect HADOOP_OPTS. - (Steven Willis via suresh) + HADOOP-8531. SequenceFile Writer can throw out a better error if a + serializer or deserializer isn't available + (Madhukara Phatak via harsh) + + HADOOP-8609. IPC server logs a useless message when shutting down socket. + (Jon Zuanich via atm) + + HADOOP-8620. Add -Drequire.fuse and -Drequire.snappy. (Colin + Patrick McCabe via eli) HADOOP-8687. Upgrade log4j to 1.2.17. (eli) @@ -150,8 +371,8 @@ Release 2.0.2-alpha - 2012-09-07 HADOOP-8372. NetUtils.normalizeHostName() incorrectly handles hostname starting with a numeric character. (Junping Du via suresh) - HADOOP-8393. hadoop-config.sh missing variable exports, causes Yarn - jobs to fail with ClassNotFoundException MRAppMaster. (phunt via tucu) + HADOOP-8393. hadoop-config.sh missing variable exports, causes Yarn jobs + to fail with ClassNotFoundException MRAppMaster. (phunt via tucu) HADOOP-8316. Audit logging should be disabled by default. (eli) @@ -188,8 +409,8 @@ Release 2.0.2-alpha - 2012-09-07 HADOOP-8485. Don't hardcode "Apache Hadoop 0.23" in the docs. (eli) - HADOOP-8488. test-patch.sh gives +1 even if the native build - fails. (Colin Patrick McCabe via eli) + HADOOP-8488. test-patch.sh gives +1 even if the native build fails. + (Colin Patrick McCabe via eli) HADOOP-8507. Avoid OOM while deserializing DelegationTokenIdentifer. (Colin Patrick McCabe via eli) @@ -267,14 +488,6 @@ Release 2.0.2-alpha - 2012-09-07 HADOOP-8699. some common testcases create core-site.xml in test-classes making other testcases to fail. (tucu) - HADOOP-8660. TestPseudoAuthenticator failing with NPE. (tucu) - - HADOOP-7703. Improved excpetion handling of shutting down web server. - (Devaraj K via Eric Yang) - - HADOOP-8699. some common testcases create core-site.xml in test-classes - making other testcases to fail. (tucu) - HADOOP-8031. Configuration class fails to find embedded .jar resources; should use URL.openStream() (genman via tucu) @@ -290,6 +503,8 @@ Release 2.0.2-alpha - 2012-09-07 HADOOP-8764. CMake: HADOOP-8737 broke ARM build. (Trevor Robinson via eli) + HADOOP-8770. NN should not RPC to self to find trash defaults. (eli) + HADOOP-8648. libhadoop: native CRC32 validation crashes when io.bytes.per.checksum=1. (Colin Patrick McCabe via eli) @@ -390,9 +605,6 @@ Release 2.0.0-alpha - 05-23-2012 HADOOP-7776. Make the Ipc-Header in a RPC-Payload an explicit header. (sanjay) - HADOOP-7717. Move handling of concurrent client fail-overs to - RetryInvocationHandler (atm) - HADOOP-7862. Move the support for multiple protocols to lower layer so that Writable, PB and Avro can all use it (Sanjay) @@ -414,25 +626,23 @@ Release 2.0.0-alpha - 05-23-2012 HADOOP-8085. Add RPC metrics to ProtobufRpcEngine. (Hari Mankude via suresh) - HADOOP-7621. alfredo config should be in a file not readable by users - (Alejandro Abdelnur via atm) HADOOP-8098. KerberosAuthenticatorHandler should use _HOST replacement to resolve principal name (tucu) HADOOP-8118. In metrics2.util.MBeans, change log level to trace for the stack trace of InstanceAlreadyExistsException. (szetszwo) - HADOOP-7994. Remove getProtocolVersion and getProtocolSignature from the - client side translator and server side implementation. (jitendra) - HADOOP-8125. make hadoop-client set of curated jars available in a distribution tarball (rvs via tucu) - HADOOP-8142. Update versions from 0.23.2 to 0.23.3 in the build files. - (szetszwo) + HADOOP-7717. Move handling of concurrent client fail-overs to + RetryInvocationHandler (atm) - HADOOP-8141. Add method to SecurityUtil to init krb5 cipher suites. - (todd) + HADOOP-7728. Enable task memory management to be configurable in hadoop + config setup script. (ramya) + + HADOOP-7358. Improve log levels when exceptions caught in RPC handler + (Todd Lipcon via shv) HADOOP-7557 Make IPC header be extensible (sanjay radia) @@ -443,7 +653,10 @@ Release 2.0.0-alpha - 05-23-2012 HADOOP-8183. Stop using "mapred.used.genericoptions.parser" (harsh) - HADOOP-7788. Add simple HealthMonitor class to watch an HAService (todd) + HADOOP-6924. Adds a directory to the list of directories to search + for the libjvm.so file. The new directory is found by running a 'find' + command and the first output is taken. This was done to handle the + build of Hadoop with IBM's JDK. (Stephen Watt, Guillermo Cabrera and ddas) HADOOP-8200. Remove HADOOP_[JOBTRACKER|TASKTRACKER]_OPTS. (eli) @@ -490,7 +703,8 @@ Release 2.0.0-alpha - 05-23-2012 HADOOP-7549. Use JDK ServiceLoader mechanism to find FileSystem implementations. (tucu) - HADOOP-8185. Update namenode -format documentation and add -nonInteractive and -force. (Arpit Gupta via atm) + HADOOP-8185. Update namenode -format documentation and add -nonInteractive + and -force. (Arpit Gupta via atm) HADOOP-8214. make hadoop script recognize a full set of deprecated commands (rvs via tucu) @@ -513,31 +727,12 @@ Release 2.0.0-alpha - 05-23-2012 HADOOP-8366 Use ProtoBuf for RpcResponseHeader (sanjay radia) - HADOOP-8620. Add -Drequire.fuse and -Drequire.snappy. (Colin - Patrick McCabe via eli) - OPTIMIZATIONS - HADOOP-8422. Deprecate FileSystem#getDefault* and getServerDefault - methods that don't take a Path argument. (eli) - - HADOOP-7818. DiskChecker#checkDir should fail if the directory is - not executable. (Madhukara Phatak via harsh) - - HADOOP-8531. SequenceFile Writer can throw out a better error if a - serializer or deserializer isn't available - (Madhukara Phatak via harsh) - - HADOOP-8609. IPC server logs a useless message when shutting down socket. - (Jon Zuanich via atm) - BUG FIXES HADOOP-8199. Fix issues in start-all.sh and stop-all.sh (Devaraj K via umamahesh) - - HADOOP-7900. LocalDirAllocator confChanged() accesses conf.get() twice - (Ravi Gummadi via Uma Maheswara Rao G) - + HADOOP-7635. RetryInvocationHandler should release underlying resources on close. (atm) @@ -759,13 +954,8 @@ Release 0.23.3 - UNRELEASED HADOOP-8535. Cut hadoop build times in half (Job Eagles via bobby) - HADOOP-8110. Fix trash checkpoint collisions (Jason Lowe via daryn) - HADOOP-8525. Provide Improved Traceability for Configuration (bobby) - HADOOP-8619. WritableComparator must implement no-arg constructor. - (Chris Douglas via Suresh) - OPTIMIZATIONS BUG FIXES @@ -890,8 +1080,10 @@ Release 0.23.3 - UNRELEASED Release 0.23.2 - UNRELEASED - NEW FEATURES + INCOMPATIBLE CHANGES + NEW FEATURES + IMPROVEMENTS HADOOP-8048. Allow merging of Credentials (Daryn Sharp via tgraves) @@ -906,7 +1098,6 @@ Release 0.23.2 - UNRELEASED acmurthy) OPTIMIZATIONS - HADOOP-8071. Avoid an extra packet in client code when nagling is disabled. (todd) @@ -988,7 +1179,7 @@ Release 0.23.1 - 2012-02-17 INCOMPATIBLE CHANGES - NEW FEATURES + NEW FEATURES HADOOP-7777 Implement a base class for DNSToSwitchMapping implementations that can offer extra topology information. (stevel) @@ -997,18 +1188,14 @@ Release 0.23.1 - 2012-02-17 HADOOP-7910. Add Configuration.getLongBytes to handle human readable byte size values. (Sho Shimauchi via harsh) - IMPROVEMENTS - HADOOP-8015. ChRootFileSystem should extend FilterFileSystem - (Daryn Sharp via bobby) + IMPROVEMENTS HADOOP-7801. HADOOP_PREFIX cannot be overriden. (Bruno Mahé via tomwhite) HADOOP-7802. Hadoop scripts unconditionally source "$bin"/../libexec/hadoop-config.sh. (Bruno Mahé via tomwhite) - HADOOP-7590. Mavenize streaming and MR examples. (tucu) - HADOOP-7858. Drop some info logging to DEBUG level in IPC, metrics, and HTTP. (todd via eli) @@ -1027,8 +1214,6 @@ Release 0.23.1 - 2012-02-17 HADOOP-6886. LocalFileSystem Needs createNonRecursive API. (Nicolas Spiegelberg and eli via eli) - HADOOP-7758. Make GlobFilter class public. (tucu) - HADOOP-7912. test-patch should run eclipse:eclipse to verify that it does not break again. (Robert Joseph Evans via tomwhite) @@ -1040,9 +1225,14 @@ Release 0.23.1 - 2012-02-17 HADOOP-7933. Add a getDelegationTokens api to FileSystem which checks for known tokens in the passed Credentials object. (sseth) - HADOOP-7808. Port HADOOP-7510 - Add configurable option to use original - hostname in token instead of IP to allow server IP change. - (Daryn Sharp via suresh) + HADOOP-7737. normalize hadoop-mapreduce & hadoop-dist dist/tar build with + common/hdfs. (tucu) + + HADOOP-7743. Add Maven profile to create a full source tarball. (tucu) + + HADOOP-7758. Make GlobFilter class public. (tucu) + + HADOOP-7590. Mavenize streaming and MR examples. (tucu) HADOOP-7934. Normalize dependencies versions across all modules. (tucu) @@ -1051,8 +1241,6 @@ Release 0.23.1 - 2012-02-17 HADOOP-7975. Add LZ4 as an entry in the default codec list, missed by HADOOP-7657 (harsh) - HADOOP-7987. Support setting the run-as user in unsecure mode. (jitendra) - HADOOP-4515. Configuration#getBoolean must not be case sensitive. (Sho Shimauchi via harsh) HADOOP-6490. Use StringUtils over String#replace in Path#normalizePath. @@ -1068,9 +1256,6 @@ Release 0.23.1 - 2012-02-17 HADOOP-7939. Improve Hadoop subcomponent integration in Hadoop 0.23. (rvs via tucu) - HADOOP-7988. Upper case in hostname part of the principals doesn't work with - kerberos. (jitendra) - HADOOP-8002. SecurityUtil acquired token message should be a debug rather than info. (Arpit Gupta via mahadev) @@ -1079,30 +1264,13 @@ Release 0.23.1 - 2012-02-17 HADOOP-7470. Move up to Jackson 1.8.8. (Enis Soztutar via szetszwo) - HADOOP-7729. Send back valid HTTP response if user hits IPC port with - HTTP GET. (todd) - HADOOP-8027. Visiting /jmx on the daemon web interfaces may print unnecessary error in logs. (atm) OPTIMIZATIONS - HADOOP-7761. Improve the performance of raw comparisons. (todd) - BUG FIXES - - HADOOP-8018. Hudson auto test for HDFS has started throwing javadoc - (Jon Eagles via bobby) - - HADOOP-8001 ChecksumFileSystem's rename doesn't correctly handle checksum - files. (Daryn Sharp via bobby) - - HADOOP-8006 TestFSInputChecker is failing in trunk. - (Daryn Sharp via bobby) - - HADOOP-7998. CheckFileSystem does not correctly honor setVerifyChecksum - (Daryn Sharp via bobby) - + HADOOP-7811. TestUserGroupInformation#testGetServerSideGroups test fails in chroot. (Jonathan Eagles via mahadev) @@ -1120,45 +1288,24 @@ Release 0.23.1 - 2012-02-17 HADOOP-6614. RunJar should provide more diags when it can't create a temp file. (Jonathan Hsieh via eli) - HADOOP-7843. compilation failing because workDir not initialized in - RunJar.java (John George via mahadev) - HADOOP-7859. TestViewFsHdfs.testgetFileLinkStatus is failing an assert. (eli) - MAPREDUCE-3465. Fixed project pom to create test dirs (and fix failing tests). - (Hitesh Shah via sseth) - HADOOP-7864. Building mvn site with Maven < 3.0.2 causes OOM errors. (Andrew Bayer via eli) - HADOOP-7853. multiple javax security configurations cause conflicts. - (daryn via tucu) - HADOOP-7854. UGI getCurrentUser is not synchronized. (Daryn Sharp via jitendra) - HADOOP-7874. native libs should be under lib/native/ dir. (tucu) - - HADOOP-7887. KerberosAuthenticatorHandler is not setting KerberosName - name rules from configuration. (tucu) - HADOOP-7870. fix SequenceFile#createWriter with boolean createParent arg to respect createParent. (Jon Hsieh via eli) - HADOOP-7902. skipping name rules setting (if already set) should be done - on UGI initialization only. (tucu) + HADOOP-7898. Fix javadoc warnings in AuthenticationToken.java. (suresh) - HADOOP-7898. Fix javadoc warnings in AuthenticationToken.java. (suresh) - - HADOOP-7878 Regression: HADOOP-7777 switch changes break HDFS tests when the - isSingleSwitch() predicate is used. (stevel) + HADOOP-7878 Regression: HADOOP-7777 switch changes break HDFS tests when the + isSingleSwitch() predicate is used. (stevel) HADOOP-7914. Remove the duplicated declaration of hadoop-hdfs test-jar in hadoop-project/pom.xml. (szetszwo) - HADOOP-7810 move hadoop archive to core from tools. (tucu) - - HADOOP_7917. compilation of protobuf files fails in windows/cygwin. (tucu) - HADOOP-7837. no NullAppender in the log4j config. (eli) HADOOP-7948. Shell scripts created by hadoop-dist/pom.xml to build tar do not @@ -1167,6 +1314,23 @@ Release 0.23.1 - 2012-02-17 HADOOP-7949. Updated maxIdleTime default in the code to match core-default.xml (eli) + HADOOP-7853. multiple javax security configurations cause conflicts. + (daryn via tucu) + + HDFS-2614. hadoop dist tarball is missing hdfs headers. (tucu) + + HADOOP-7874. native libs should be under lib/native/ dir. (tucu) + + HADOOP-7887. KerberosAuthenticatorHandler is not setting + KerberosName name rules from configuration. (tucu) + + HADOOP-7902. skipping name rules setting (if already set) should be done + on UGI initialization only. (tucu) + + HADOOP-7810. move hadoop archive to core from tools. (tucu) + + HADOOP_7917. compilation of protobuf files fails in windows/cygwin. (tucu) + HADOOP-7907. hadoop-tools JARs are not part of the distro. (tucu) HADOOP-7936. There's a Hoop README in the root dir of the tarball. (tucu) @@ -1280,9 +1444,6 @@ Release 0.23.0 - 2011-11-01 IMPROVEMENTS - HADOOP-7728. Enable task memory management to be configurable in hadoop - config setup script. (ramya) - HADOOP-7655. Provide a small validation script that smoke tests the installed cluster. (Arpit Gupta via mattf) @@ -1565,11 +1726,6 @@ Release 0.23.0 - 2011-11-01 HADOOP-7594. Support HTTP REST in HttpServer. (szetszwo) - HADOOP-7595. Upgrade dependency to Avro 1.5.3. (Alejandro Abdelnur via atm) - - HADOOP-7604. Hadoop Auth examples pom in 0.23 point to 0.24 versions. - (mahadev) - HADOOP-7552. FileUtil#fullyDelete doesn't throw IOE but lists it in the throws clause. (eli) @@ -1595,7 +1751,7 @@ Release 0.23.0 - 2011-11-01 HADOOP-7469 Add a standard handler for socket connection problems which improves diagnostics (Uma Maheswara Rao G and stevel via stevel) - HADOOP-7710. Added hadoop-setup-application.sh for creating + HADOOP-7710. Added hadoop-setup-application.sh for creating application directory (Arpit Gupta via Eric Yang) HADOOP-7707. Added toggle for dfs.support.append, webhdfs and hadoop proxy @@ -1604,12 +1760,14 @@ Release 0.23.0 - 2011-11-01 HADOOP-7720. Added parameter for HBase user to setup config script. (Arpit Gupta via Eric Yang) - HADOOP-7724. Fixed hadoop-setup-conf.sh to put proxy user in - core-site.xml. (Arpit Gupta via Eric Yang) + HADOOP-7624. Set things up for a top level hadoop-tools module. (tucu) HADOOP-7627. Improve MetricsAsserts to give more understandable output on failure. (todd) + HADOOP-7642. create hadoop-dist module where TAR stitching would happen. + (Thomas White via tucu) + HADOOP-7709. Running a set of methods in a Single Test Class. (Jonathan Eagles via mahadev) @@ -1620,7 +1778,7 @@ Release 0.23.0 - 2011-11-01 help in exception messages. (todd) HADOOP-7762. Common side of MR-2736. (eli) - + HADOOP-7668. Add a NetUtils method that can tell if an InetAddress belongs to local host. (suresh) @@ -1635,16 +1793,6 @@ Release 0.23.0 - 2011-11-01 HADOOP-7360. Preserve relative paths that do not contain globs in FsShell. (Daryn Sharp and Kihwal Lee via szetszwo) - HADOOP-7624. Set things up for a top level hadoop-tools module. (tucu) - - HADOOP-7642. create hadoop-dist module where TAR stitching would happen. - (Thomas White via tucu) - - HADOOP-7737. normalize hadoop-mapreduce & hadoop-dist dist/tar build with - common/hdfs. (tucu) - - HADOOP-7743. Add Maven profile to create a full source tarball. (tucu) - HADOOP-7771. FsShell -copyToLocal, -get, etc. commands throw NPE if the destination directory does not exist. (John George and Daryn Sharp via szetszwo) @@ -1653,9 +1801,6 @@ Release 0.23.0 - 2011-11-01 HADOOP-7789. Improvements to site navigation. (acmurthy) - HADOOP-7792. Add verifyToken method to AbstractDelegationTokenSecretManager. - (jitendra) - OPTIMIZATIONS HADOOP-7333. Performance improvement in PureJavaCrc32. (Eric Caspole @@ -1863,9 +2008,6 @@ Release 0.23.0 - 2011-11-01 HADOOP-7593. Fix AssertionError in TestHttpServer.testMaxThreads(). (Uma Maheswara Rao G via szetszwo) - HADOOP-7606. Upgrade Jackson to version 1.7.1 to match the version required - by Jersey (Alejandro Abdelnur via atm) - HADOOP-7598. Fix smart-apply-patch.sh to handle patching from a sub directory correctly. (Robert Evans via acmurthy) @@ -1888,10 +2030,6 @@ Release 0.23.0 - 2011-11-01 HADOOP-7631. Fixes a config problem to do with running streaming jobs (Eric Yang via ddas) - - HADOOP-7671 Add license headers to - hadoop-common/src/main/packages/templates/conf/ - (Ravi Prakash via stevel) HADOOP-7662. Fixed logs servlet to use the pathspec '/*' instead of '/' for correct filtering. (Thomas Graves via vinodkv) @@ -1918,9 +2056,12 @@ Release 0.23.0 - 2011-11-01 HADOOP-7681. Fixed security and hdfs audit log4j properties (Arpit Gupta via Eric Yang) - HADOOP-7708. Fixed hadoop-setup-conf.sh to handle config file + HADOOP-7708. Fixed hadoop-setup-conf.sh to handle config files consistently. (Eric Yang) + HADOOP-7724. Fixed hadoop-setup-conf.sh to put proxy user in + core-site.xml. (Arpit Gupta via Eric Yang) + HADOOP-7755. Detect MapReduce PreCommit Trunk builds silently failing when running test-patch.sh. (Jonathan Eagles via tomwhite) @@ -1928,18 +2069,16 @@ Release 0.23.0 - 2011-11-01 Eagles via acmurthy) HADOOP-7764. Allow HttpServer to set both ACL list and path spec filters. - (Jonathan Eagles via acmurthy) + (Jonathan Eagles via acmurthy) HADOOP-7766. The auth to local mappings are not being respected, with webhdfs and security enabled. (jitendra) - HADOOP-7721. Add log before login in KerberosAuthenticationHandler. (jitendra) + HADOOP-7721. Add log before login in KerberosAuthenticationHandler. + (jitendra) HADOOP-7778. FindBugs warning in Token.getKind(). (tomwhite) - HADOOP-7770. ViewFS getFileChecksum throws FileNotFoundException for files in - /tmp and /user. (Ravi Prakash via jitendra) - HADOOP-7798. Add support gpg signatures for maven release artifacts. (cutting via acmurthy) @@ -2217,8 +2356,8 @@ Release 0.22.0 - 2011-11-29 HADOOP-7786. Remove HDFS-specific config keys defined in FsConfig. (eli) - HADOOP-7358. Improve log levels when exceptions caught in RPC handler - (Todd Lipcon via shv) + HADOOP-7861. changes2html.pl generates links to HADOOP, HDFS, and MAPREDUCE + jiras. (shv) OPTIMIZATIONS diff --git a/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/conf/Configuration.java b/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/conf/Configuration.java index 9fc5c028bf7..055fb6364d8 100644 --- a/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/conf/Configuration.java +++ b/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/conf/Configuration.java @@ -2297,4 +2297,14 @@ public class Configuration implements Iterable>, * for getClassByName. {@see Configuration#getClassByNameOrNull(String)} */ private static abstract class NegativeCacheSentinel {} + + public static void dumpDeprecatedKeys() { + for (Map.Entry entry : deprecatedKeyMap.entrySet()) { + String newKeys = ""; + for (String newKey : entry.getValue().newKeys) { + newKeys += newKey + "\t"; + } + System.out.println(entry.getKey() + "\t" + newKeys); + } + } } diff --git a/hadoop-common-project/hadoop-common/src/site/apt/DeprecatedProperties.apt.vm b/hadoop-common-project/hadoop-common/src/site/apt/DeprecatedProperties.apt.vm index 32686d68e16..258af0fe2b9 100644 --- a/hadoop-common-project/hadoop-common/src/site/apt/DeprecatedProperties.apt.vm +++ b/hadoop-common-project/hadoop-common/src/site/apt/DeprecatedProperties.apt.vm @@ -24,8 +24,6 @@ Deprecated Properties *-------------------------------+-----------------------+ || <> || <>| *-------------------------------+-----------------------+ -|StorageId | dfs.datanode.StorageId -*---+---+ |create.empty.dir.if.nonexist | mapreduce.jobcontrol.createdir.ifnotexist *---+---+ |dfs.access.time.precision | dfs.namenode.accesstime.precision @@ -38,14 +36,16 @@ Deprecated Properties *---+---+ |dfs.block.size | dfs.blocksize *---+---+ -|dfs.client.buffer.dir | fs.client.buffer.dir -*---+---+ |dfs.data.dir | dfs.datanode.data.dir *---+---+ |dfs.datanode.max.xcievers | dfs.datanode.max.transfer.threads *---+---+ |dfs.df.interval | fs.df.interval *---+---+ +|dfs.federation.nameservice.id | dfs.nameservice.id +*---+---+ +|dfs.federation.nameservices | dfs.nameservices +*---+---+ |dfs.http.address | dfs.namenode.http-address *---+---+ |dfs.https.address | dfs.namenode.https-address @@ -54,10 +54,10 @@ Deprecated Properties *---+---+ |dfs.https.need.client.auth | dfs.client.https.need-auth *---+---+ -|dfs.max-repl-streams | dfs.namenode.replication.max-streams -*---+---+ |dfs.max.objects | dfs.namenode.max.objects *---+---+ +|dfs.max-repl-streams | dfs.namenode.replication.max-streams +*---+---+ |dfs.name.dir | dfs.namenode.name.dir *---+---+ |dfs.name.dir.restore | dfs.namenode.name.dir.restore @@ -86,7 +86,7 @@ Deprecated Properties *---+---+ |dfs.socket.timeout | dfs.client.socket-timeout *---+---+ -|dfs.upgrade.permission | dfs.namenode.upgrade.permission +|dfs.umaskmode | fs.permissions.umask-mode *---+---+ |dfs.write.packet.size | dfs.client-write-packet-size *---+---+ @@ -108,10 +108,10 @@ Deprecated Properties *---+---+ |hadoop.pipes.command-file.keep | mapreduce.pipes.commandfile.preserve *---+---+ -|hadoop.pipes.executable | mapreduce.pipes.executable -*---+---+ |hadoop.pipes.executable.interpretor | mapreduce.pipes.executable.interpretor *---+---+ +|hadoop.pipes.executable | mapreduce.pipes.executable +*---+---+ |hadoop.pipes.java.mapper | mapreduce.pipes.isjavamapper *---+---+ |hadoop.pipes.java.recordreader | mapreduce.pipes.isjavarecordreader @@ -132,6 +132,12 @@ Deprecated Properties *---+---+ |io.sort.spill.percent | mapreduce.map.sort.spill.percent *---+---+ +|jobclient.completion.poll.interval | mapreduce.client.completion.pollinterval +*---+---+ +|jobclient.output.filter | mapreduce.client.output.filter +*---+---+ +|jobclient.progress.monitor.poll.interval | mapreduce.client.progressmonitor.pollinterval +*---+---+ |job.end.notification.url | mapreduce.job.end-notification.url *---+---+ |job.end.retry.attempts | mapreduce.job.end-notification.retry.attempts @@ -140,12 +146,6 @@ Deprecated Properties *---+---+ |job.local.dir | mapreduce.job.local.dir *---+---+ -|jobclient.completion.poll.interval | mapreduce.client.completion.pollinterval -*---+---+ -|jobclient.output.filter | mapreduce.client.output.filter -*---+---+ -|jobclient.progress.monitor.poll.interval | mapreduce.client.progressmonitor.pollinterval -*---+---+ |keep.failed.task.files | mapreduce.task.files.preserve.failedtasks *---+---+ |keep.task.files.pattern | mapreduce.task.files.preserve.filepattern @@ -198,10 +198,6 @@ Deprecated Properties *---+---+ |mapred.compress.map.output | mapreduce.map.output.compress *---+---+ -|mapred.create.symlink | NONE - symlinking is always on -*---+---+ -|mapreduce.job.cache.symlink.create | NONE - symlinking is always on -*---+---+ |mapred.data.field.separator | mapreduce.fieldsel.data.field.separator *---+---+ |mapred.debug.out.lines | mapreduce.task.debugout.lines @@ -216,18 +212,18 @@ Deprecated Properties *---+---+ |mapred.heartbeats.in.second | mapreduce.jobtracker.heartbeats.in.second *---+---+ -|mapred.hosts | mapreduce.jobtracker.hosts.filename -*---+---+ |mapred.hosts.exclude | mapreduce.jobtracker.hosts.exclude.filename *---+---+ -|mapred.inmem.merge.threshold | mapreduce.reduce.merge.inmem.threshold +|mapred.hosts | mapreduce.jobtracker.hosts.filename *---+---+ -|mapred.input.dir | mapreduce.input.fileinputformat.inputdir +|mapred.inmem.merge.threshold | mapreduce.reduce.merge.inmem.threshold *---+---+ |mapred.input.dir.formats | mapreduce.input.multipleinputs.dir.formats *---+---+ |mapred.input.dir.mappers | mapreduce.input.multipleinputs.dir.mappers *---+---+ +|mapred.input.dir | mapreduce.input.fileinputformat.inputdir +*---+---+ |mapred.input.pathFilter.class | mapreduce.input.pathFilter.class *---+---+ |mapred.jar | mapreduce.job.jar @@ -238,6 +234,8 @@ Deprecated Properties *---+---+ |mapred.job.id | mapreduce.job.id *---+---+ +|mapred.jobinit.threads | mapreduce.jobtracker.jobinit.threads +*---+---+ |mapred.job.map.memory.mb | mapreduce.map.memory.mb *---+---+ |mapred.job.name | mapreduce.job.name @@ -260,42 +258,40 @@ Deprecated Properties *---+---+ |mapred.job.shuffle.merge.percent | mapreduce.reduce.shuffle.merge.percent *---+---+ -|mapred.job.tracker | mapreduce.jobtracker.address -*---+---+ |mapred.job.tracker.handler.count | mapreduce.jobtracker.handler.count *---+---+ |mapred.job.tracker.history.completed.location | mapreduce.jobtracker.jobhistory.completed.location *---+---+ |mapred.job.tracker.http.address | mapreduce.jobtracker.http.address *---+---+ +|mapred.jobtracker.instrumentation | mapreduce.jobtracker.instrumentation +*---+---+ +|mapred.jobtracker.job.history.block.size | mapreduce.jobtracker.jobhistory.block.size +*---+---+ |mapred.job.tracker.jobhistory.lru.cache.size | mapreduce.jobtracker.jobhistory.lru.cache.size *---+---+ +|mapred.job.tracker | mapreduce.jobtracker.address +*---+---+ +|mapred.jobtracker.maxtasks.per.job | mapreduce.jobtracker.maxtasks.perjob +*---+---+ |mapred.job.tracker.persist.jobstatus.active | mapreduce.jobtracker.persist.jobstatus.active *---+---+ |mapred.job.tracker.persist.jobstatus.dir | mapreduce.jobtracker.persist.jobstatus.dir *---+---+ |mapred.job.tracker.persist.jobstatus.hours | mapreduce.jobtracker.persist.jobstatus.hours *---+---+ -|mapred.job.tracker.retire.jobs | mapreduce.jobtracker.retirejobs +|mapred.jobtracker.restart.recover | mapreduce.jobtracker.restart.recover *---+---+ |mapred.job.tracker.retiredjobs.cache.size | mapreduce.jobtracker.retiredjobs.cache.size *---+---+ -|mapred.jobinit.threads | mapreduce.jobtracker.jobinit.threads +|mapred.job.tracker.retire.jobs | mapreduce.jobtracker.retirejobs *---+---+ -|mapred.jobtracker.instrumentation | mapreduce.jobtracker.instrumentation -*---+---+ -|mapred.jobtracker.job.history.block.size | mapreduce.jobtracker.jobhistory.block.size -*---+---+ -|mapred.jobtracker.maxtasks.per.job | mapreduce.jobtracker.maxtasks.perjob -*---+---+ -|mapred.jobtracker.restart.recover | mapreduce.jobtracker.restart.recover +|mapred.jobtracker.taskalloc.capacitypad | mapreduce.jobtracker.taskscheduler.taskalloc.capacitypad *---+---+ |mapred.jobtracker.taskScheduler | mapreduce.jobtracker.taskscheduler *---+---+ |mapred.jobtracker.taskScheduler.maxRunningTasksPerJob | mapreduce.jobtracker.taskscheduler.maxrunningtasks.perjob *---+---+ -|mapred.jobtracker.taskalloc.capacitypad | mapreduce.jobtracker.taskscheduler.taskalloc.capacitypad -*---+---+ |mapred.join.expr | mapreduce.join.expr *---+---+ |mapred.join.keycomparator | mapreduce.join.keycomparator @@ -322,20 +318,20 @@ Deprecated Properties *---+---+ |mapred.map.output.compression.codec | mapreduce.map.output.compress.codec *---+---+ +|mapred.mapoutput.key.class | mapreduce.map.output.key.class +*---+---+ +|mapred.mapoutput.value.class | mapreduce.map.output.value.class +*---+---+ +|mapred.mapper.regex.group | mapreduce.mapper.regexmapper..group +*---+---+ +|mapred.mapper.regex | mapreduce.mapper.regex +*---+---+ |mapred.map.task.debug.script | mapreduce.map.debug.script *---+---+ |mapred.map.tasks | mapreduce.job.maps *---+---+ |mapred.map.tasks.speculative.execution | mapreduce.map.speculative *---+---+ -|mapred.mapoutput.key.class | mapreduce.map.output.key.class -*---+---+ -|mapred.mapoutput.value.class | mapreduce.map.output.value.class -*---+---+ -|mapred.mapper.regex | mapreduce.mapper.regex -*---+---+ -|mapred.mapper.regex.group | mapreduce.mapper.regexmapper..group -*---+---+ |mapred.max.map.failures.percent | mapreduce.map.failures.maxpercent *---+---+ |mapred.max.reduce.failures.percent | mapreduce.reduce.failures.maxpercent @@ -354,12 +350,12 @@ Deprecated Properties *---+---+ |mapred.min.split.size.per.rack | mapreduce.input.fileinputformat.split.minsize.per.rack *---+---+ -|mapred.output.compress | mapreduce.output.fileoutputformat.compress -*---+---+ |mapred.output.compression.codec | mapreduce.output.fileoutputformat.compress.codec *---+---+ |mapred.output.compression.type | mapreduce.output.fileoutputformat.compress.type *---+---+ +|mapred.output.compress | mapreduce.output.fileoutputformat.compress +*---+---+ |mapred.output.dir | mapreduce.output.fileoutputformat.outputdir *---+---+ |mapred.output.key.class | mapreduce.job.output.key.class @@ -442,12 +438,6 @@ Deprecated Properties *---+---+ |mapred.task.timeout | mapreduce.task.timeout *---+---+ -|mapred.task.tracker.http.address | mapreduce.tasktracker.http.address -*---+---+ -|mapred.task.tracker.report.address | mapreduce.tasktracker.report.address -*---+---+ -|mapred.task.tracker.task-controller | mapreduce.tasktracker.taskcontroller -*---+---+ |mapred.tasktracker.dns.interface | mapreduce.tasktracker.dns.interface *---+---+ |mapred.tasktracker.dns.nameserver | mapreduce.tasktracker.dns.nameserver @@ -456,6 +446,8 @@ Deprecated Properties *---+---+ |mapred.tasktracker.expiry.interval | mapreduce.jobtracker.expire.trackers.interval *---+---+ +|mapred.task.tracker.http.address | mapreduce.tasktracker.http.address +*---+---+ |mapred.tasktracker.indexcache.mb | mapreduce.tasktracker.indexcache.mb *---+---+ |mapred.tasktracker.instrumentation | mapreduce.tasktracker.instrumentation @@ -468,6 +460,10 @@ Deprecated Properties *---+---+ |mapred.tasktracker.reduce.tasks.maximum | mapreduce.tasktracker.reduce.tasks.maximum *---+---+ +|mapred.task.tracker.report.address | mapreduce.tasktracker.report.address +*---+---+ +|mapred.task.tracker.task-controller | mapreduce.tasktracker.taskcontroller +*---+---+ |mapred.tasktracker.taskmemorymanager.monitoring-interval | mapreduce.tasktracker.taskmemorymanager.monitoringinterval *---+---+ |mapred.tasktracker.tasks.sleeptime-before-sigkill | mapreduce.tasktracker.tasks.sleeptimebeforesigkill @@ -482,20 +478,12 @@ Deprecated Properties *---+---+ |mapred.tip.id | mapreduce.task.id *---+---+ -|mapred.used.genericoptionsparser | mapreduce.client.genericoptionsparser.used -*---+---+ -|mapred.userlog.limit.kb | mapreduce.task.userlog.limit.kb -*---+---+ -|mapred.userlog.retain.hours | mapreduce.job.userlog.retain.hours -*---+---+ -|mapred.work.output.dir | mapreduce.task.output.dir -*---+---+ -|mapred.working.dir | mapreduce.job.working.dir -*---+---+ |mapreduce.combine.class | mapreduce.job.combine.class *---+---+ |mapreduce.inputformat.class | mapreduce.job.inputformat.class *---+---+ +|mapreduce.job.counters.limit | mapreduce.job.counters.max +*---+---+ |mapreduce.jobtracker.permissions.supergroup | mapreduce.cluster.permissions.supergroup *---+---+ |mapreduce.map.class | mapreduce.job.map.class @@ -506,6 +494,16 @@ Deprecated Properties *---+---+ |mapreduce.reduce.class | mapreduce.job.reduce.class *---+---+ +|mapred.used.genericoptionsparser | mapreduce.client.genericoptionsparser.used +*---+---+ +|mapred.userlog.limit.kb | mapreduce.task.userlog.limit.kb +*---+---+ +|mapred.userlog.retain.hours | mapreduce.job.userlog.retain.hours +*---+---+ +|mapred.working.dir | mapreduce.job.working.dir +*---+---+ +|mapred.work.output.dir | mapreduce.task.output.dir +*---+---+ |min.num.spills.for.combine | mapreduce.map.combine.minspills *---+---+ |reduce.output.key.value.fields.spec | mapreduce.fieldsel.reduce.output.key.value.fields.spec @@ -539,4 +537,14 @@ Deprecated Properties |user.name | mapreduce.job.user.name *---+---+ |webinterface.private.actions | mapreduce.jobtracker.webinterface.trusted +*---+---+ + + The following table lists additional changes to some configuration properties: + +*-------------------------------+-----------------------+ +|| <> || <>| +*-------------------------------+-----------------------+ +|mapred.create.symlink | NONE - symlinking is always on +*---+---+ +|mapreduce.job.cache.symlink.create | NONE - symlinking is always on *---+---+ diff --git a/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/HdfsConfiguration.java b/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/HdfsConfiguration.java index 022cf58aeb5..6120931b1bb 100644 --- a/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/HdfsConfiguration.java +++ b/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/HdfsConfiguration.java @@ -105,4 +105,9 @@ public class HdfsConfiguration extends Configuration { deprecate("dfs.federation.nameservices", DFSConfigKeys.DFS_NAMESERVICES); deprecate("dfs.federation.nameservice.id", DFSConfigKeys.DFS_NAMESERVICE_ID); } + + public static void main(String[] args) { + init(); + Configuration.dumpDeprecatedKeys(); + } } diff --git a/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/util/ConfigUtil.java b/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/util/ConfigUtil.java index dbbd786edfc..22f5a1caba4 100644 --- a/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/util/ConfigUtil.java +++ b/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/util/ConfigUtil.java @@ -520,5 +520,10 @@ public class ConfigUtil { MRJobConfig.MR_AM_SECURITY_SERVICE_AUTHORIZATION_CLIENT }); } + + public static void main(String[] args) { + loadResources(); + Configuration.dumpDeprecatedKeys(); + } }