Commit Graph

8582 Commits

Author SHA1 Message Date
Harsh J 2684b0b440 MAPREDUCE-4414. Add main methods to JobConf and YarnConfiguration, for debug purposes. Contributed by Plamen Jeliazkov.
(cherry picked from commit 571f75b468a4412be2178466cb5d3888b05cd076)
2015-03-17 01:02:21 +05:30
Colin Patrick Mccabe eb4eb63de3 HADOOP-11714. Add more trace log4j messages to SpanReceiverHost (cmccabe)
(cherry picked from commit bf3275dbaa)
2015-03-16 12:03:10 -07:00
Zhijie Shen fbe811d904 YARN-2854. Updated the documentation of the timeline service and the generic history service. Contributed by Naganarasimha G R. 2015-03-16 10:52:32 -07:00
Tsuyoshi Ozawa d6e3ef2506 YARN-1453. [JDK8] Fix Javadoc errors caused by incorrect or illegal tags in doc comments. Contributed by Akira AJISAKA, Andrew Purtell, and Allen Wittenauer.
(cherry picked from commit 3da9a97cfb)
2015-03-16 23:20:17 +09:00
Xuan b6eb36dbdc YARN-3171. Sort by Application id, AppAttempt and ContainerID doesn't
work in ATS / RM web ui. Contributed by Naganarasimha G R

(cherry picked from commit 3ff1ba2a7b)
2015-03-15 20:27:44 -07:00
Colin Patrick Mccabe c71b54fa32 HDFS-7915. The DataNode can sometimes allocate a ShortCircuitShm slot and fail to tell the DFSClient about it because of a network error (cmccabe)
(cherry picked from commit bc9cb3e271)
2015-03-14 22:41:50 -07:00
Tsuyoshi Ozawa 4489a02634 HADOOP-11558. Fix dead links to doc of hadoop-tools. Contributed by Jean-Pierre Matsumoto.
(cherry picked from commit 79426f3334)
2015-03-15 14:30:12 +09:00
Tsuyoshi Ozawa 1802df8373 Revert "HADOOP-11558. Fix dead links to doc of hadoop-tools. Contributed by Masatake Iwasaki."
This reverts commit 54a73a6b5f.
2015-03-15 14:27:56 +09:00
Tsuyoshi Ozawa 54a73a6b5f HADOOP-11558. Fix dead links to doc of hadoop-tools. Contributed by Masatake Iwasaki.
(cherry picked from commit 7da136ecca)
2015-03-15 14:18:01 +09:00
Tsuyoshi Ozawa c5c544c1b7 Moving CHANGES.txt entry for MAPREDUCE-4742 to branch-2.7.
(cherry picked from commit bd0a9ba8e3)
2015-03-14 16:54:50 +09:00
Tsuyoshi Ozawa 10745fcecd MAPREDUCE-6265. Make ContainerLauncherImpl.INITIAL_POOL_SIZE configurable to better control to launch/kill containers. Contributed by Zhihai Xu
(cherry picked from commit 9d38520c8e)

Conflicts:
	hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/resources/mapred-default.xml
2015-03-14 16:45:23 +09:00
Colin Patrick Mccabe f93a2dd94b Revert "HDFS-7915. The DataNode can sometimes allocate a ShortCircuitShm slot and fail to tell the DFSClient about it because of a network error (cmccabe)" (Jenkins didn't run yet)
This reverts commit 7550052b85.
2015-03-13 18:39:43 -07:00
Colin Patrick Mccabe 7550052b85 HDFS-7915. The DataNode can sometimes allocate a ShortCircuitShm slot and fail to tell the DFSClient about it because of a network error (cmccabe)
(cherry picked from commit 5aa892ed48)
2015-03-13 18:30:36 -07:00
Konstantin V Shvachko 8afbfed5d3 HDFS-2605. Remove redundant "Release 0.21.1" section from CHANGES.txt. Contributed by Allen Wittenauer. 2015-03-13 13:45:13 -07:00
Konstantin V Shvachko b199081f54 HDFS-7903. Cannot recover block after truncate and delete snapshot. Contributed by Plamen Jeliazkov. 2015-03-13 12:40:38 -07:00
Kihwal Lee 464271a5ed HDFS-7435. PB encoding of block reports is very inefficient. Contributed by Daryn Sharp.
(cherry picked from commit d324164a51)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/FsDatasetImpl.java
2015-03-13 14:36:34 -05:00
Brandon Li af80a98ace HDFS-7926. NameNode implementation of ClientProtocol.truncate(..) is not idempotent. Contributed by Tsz Wo Nicholas Sze
(cherry picked from commit f446669afb)
2015-03-13 10:43:46 -07:00
Jonathan Eagles 44aedad5dd YARN-3267. Timelineserver applies the ACL rules after applying the limit on the number of records (Chang Li via jeagles)
(cherry picked from commit 8180e676ab)
2015-03-13 12:05:21 -05:00
Andrew Wang 146abadb96 HADOOP-11711. Provide a default value for AES/CTR/NoPadding CryptoCodec classes.
(cherry picked from commit 387f271c81)
2015-03-12 21:41:29 -07:00
yliu 813c93cb25 HADOOP-11710. Make CryptoOutputStream behave like DFSOutputStream wrt synchronization. (Sean Busbey via yliu) 2015-03-13 02:26:16 +08:00
Yongjun Zhang 32e62cb3d0 HADOOP-9477. Add posixGroups support for LDAP groups mapping service. (Dapeng Sun via Yongjun Zhang)
(cherry picked from commit 8212877415)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
2015-03-12 15:10:20 -07:00
Vinod Kumar Vavilapalli 53aa3a4d1f YARN-3154. Added additional APIs in LogAggregationContext to avoid aggregating running logs of application when rolling is enabled. Contributed by Xuan Gong.
(cherry picked from commit 863079bb87)
2015-03-12 13:33:42 -07:00
Colin Patrick Mccabe 7455412a24 HDFS-7722. DataNode#checkDiskError should also remove Storage when error is found. (Lei Xu via Colin P. McCabe)
(cherry picked from commit b49c3a1813)
2015-03-12 12:40:38 -07:00
Tsz-Wo Nicholas Sze 981a1fa815 HDFS-6833. DirectoryScanner should not register a deleting block with memory of DataNode. Contributed by Shinichi Yamashita 2015-03-13 02:27:37 +08:00
Xuan 498d775c9b YARN-3338. Exclude jline dependency from YARN. Contributed by Zhijie
Shen

(cherry picked from commit 06ce1d9a6c)
2015-03-12 10:25:55 -07:00
cnauroth 86bb9c5808 HADOOP-10027. *Compressor_deflateBytesDirect passes instance instead of jclass to GetStaticObjectField. Contributed by Hui Zheng.
(cherry picked from commit ff83ae7231)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
2015-03-11 23:28:36 -07:00
Zhijie Shen 426535007b YARN-1884. Added nodeHttpAddress into ContainerReport and fixed the link to NM web page. Contributed by Xuan Gong.
(cherry picked from commit 85f6d67fa7)
2015-03-11 19:39:46 -07:00
Akira Ajisaka 6c80a3d34a HDFS-7880. Remove the tests for legacy Web UI in branch-2. Contributed by Brahma Reddy Battula. 2015-03-12 10:41:34 +09:00
cnauroth dcc4850ff3 HADOOP-11693. Azure Storage FileSystem rename operations are throttled too aggressively to complete HBase WAL archiving. Contributed by Duo Xu.
(cherry picked from commit 7a346bcb4f)
2015-03-11 14:37:22 -07:00
Haohui Mai e75e6c66ea HADOOP-11633. Convert remaining branch-2 .apt.vm files to markdown. Contributed by Masatake Iwasaki. 2015-03-11 14:23:44 -07:00
cnauroth 5e99b7cd2f HDFS-7491. Add incremental blockreport latency to DN metrics. Contributed by Ming Ma.
(cherry picked from commit fb34f45727)
2015-03-11 14:11:39 -07:00
Tsuyoshi Ozawa d29cf296cb YARN-3295. Fix documentation nits found in markdown conversion. Contributed by Masatake Iwasaki.
(cherry picked from commit 30c428a858)
2015-03-11 15:02:45 +09:00
Colin Patrick Mccabe eefca23e8c HDFS-7830. DataNode does not release the volume lock when adding a volume fails. (Lei Xu via Colin P. McCabe)
(cherry picked from commit 5c1036d598)
2015-03-10 19:45:18 -07:00
Gera Shegalov f1b32d1436 DelegateToFileSystem erroneously uses default FS's port in constructor. (Brahma Reddy Battula via gera)
(cherry picked from commit 64eb068ee8)
2015-03-10 14:10:39 -07:00
Gera Shegalov 6802e8fefc MAPREDUCE-4815. Speed up FileOutputCommitter#commitJob for many output files. (Siqi Li via gera)
(cherry picked from commit aa92b764a7)
2015-03-10 11:40:45 -07:00
Jian He 2690c72522 YARN-3187. Documentation of Capacity Scheduler Queue mapping based on user or group. Contributed by Gururaj Shetty
(cherry picked from commit a380643d20)
2015-03-10 11:16:51 -07:00
Tsuyoshi Ozawa 482504befd MAPREDUCE-4742. Fix typo in nnbench#displayUsage. Contributed by Liang Xie.
(cherry picked from commit 20b8ee1350)
2015-03-11 00:41:37 +09:00
Junping Du dbcdcb0d3c Configurable timeout between YARNRunner terminate the application and forcefully kill. Contributed by Eric Payne.
(cherry picked from commit d39bc903a0)
2015-03-10 06:23:24 -07:00
Vinayakumar B 2f902a823c HADOOP-11568. Description on usage of classpath in hadoop command is incomplete. ( Contributed by Archana T ) 2015-03-10 13:02:56 +05:30
Tsuyoshi Ozawa 5efee5efd3 HADOOP-11226. Add a configuration to set ipc.Client's traffic class with IPTOS_LOWDELAY|IPTOS_RELIABILITY. Contributed by Gopal V.
(cherry picked from commit 54639c7d7a)
2015-03-10 13:09:05 +09:00
Jian He 4021451746 YARN-3300. Outstanding_resource_requests table should not be shown in AHS. Contributed by Xuan Gong
(cherry picked from commit c3003eba6f)
2015-03-09 20:47:33 -07:00
Akira Ajisaka 2d3c5507ce HDFS-6806. HDFS Rolling upgrade document should mention the versions available. Contributed by J.Andreina.
(cherry picked from commit 82db3341bf)
2015-03-10 11:23:06 +09:00
Zhijie Shen a94d23762e YARN-3287. Made TimelineClient put methods do as the correct login context. Contributed by Daryn Sharp and Jonathan Eagles.
(cherry picked from commit d6e05c5ee2)
2015-03-09 13:55:51 -07:00
Yongjun Zhang 45cc7514f5 HADOOP-11692. Improve authentication failure WARN message to avoid user confusion. Contributed by Yongjun Zhang.
(cherry picked from commit de1101cb5b)

Conflicts:
	hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/ipc/Server.java
2015-03-09 12:12:29 -07:00
Haohui Mai d8d8ed35f0 HADOOP-11686. MiniKDC cannot change ORG_NAME or ORG_DOMAIN. Contributed by Duo Zhang. 2015-03-09 11:08:35 -07:00
Jing Zhao c7105fcff0 HDFS-7898. Change TestAppendSnapshotTruncate to fail-fast. Contributed by Tsz Wo Nicholas Sze.
(cherry picked from commit e43882e84a)
2015-03-09 10:52:39 -07:00
Tsuyoshi Ozawa b46f9e72db HADOOP-11602. Backport 'Fix toUpperCase/toLowerCase to use Locale.ENGLISH.' (ozawa) 2015-03-09 19:53:55 +09:00
Vinod Kumar Vavilapalli d9416317a9 Preparing for 2.8.0 development. Changing SNAPSHOT version to be 2.8 on branch-2. 2015-03-08 20:32:51 -07:00
Vinod Kumar Vavilapalli 8e6f8e9a04 Adding 2.8 section in CHANGES.txt 2015-03-08 20:26:57 -07:00
Tsuyoshi Ozawa 3c24e50ce2 Update CHANGES.txt for MAPREDUCE-5657. 2015-03-09 12:07:56 +09:00