Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
10,769 Commits 326 Branches 371 Tags
Commit Graph

10769 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Yongjun Zhang
a1f913fb6e HADOOP-12718. Incorrect error message by fs -put local dir without permission. (John Zhuge via Yongjun Zhang) 
(cherry picked from commit 97056c3355810a803f07baca89b89e2bf6bb7201)
 2016-01-27 08:05:17 -08:00
Rohith Sharma K S
0b8767e01a YARN-4573. Fix test failure in TestRMAppTransitions#testAppRunningKill and testAppKilledKilled. (Takashi Ohnishi via rohithsharmaks) 
(cherry picked from commit c01bee010832ca31d8e60e5461181cdf05140602)
 2016-01-27 08:24:37 +05:30
Xuan
69f3fa71a2 YARN-4612. Fix rumen and scheduler load simulator handle killed tasks 
properly. Contributed by Ming Ma.

(cherry picked from commit 4efdf3a979c361348612f817a3253be6d0de58f7)
 2016-01-26 18:18:03 -08:00
Zhe Zhang
2056dd7d3a HDFS-9541. Add hdfsStreamBuilder API to libhdfs to support defaultBlockSizes greater than 2 GB. Contributed by Colin Patrick McCabe. 
Change-Id: Ifce1b9be534dc8f7e9d2634cd60e423921b9810f
 2016-01-26 11:26:31 -08:00
Jian He
ad42229683 MAPREDUCE-6610. JobHistoryEventHandler should not swallow timeline response. Contributed by Li Lu 2016-01-25 23:01:29 -08:00
Tsz-Wo Nicholas Sze
c59c142f47 HDFS-9690. ClientProtocol.addBlock is not idempotent after HDFS-8071. 2016-01-26 14:56:23 +08:00
Jitendra Pandey
4334976187 HDFS-9672. o.a.h.hdfs.TestLeaseRecovery2 fails intermittently. Contributed by Mingliang Liu. 2016-01-25 17:06:36 -08:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
47b20d0c74 YARN-3542. Refactored existing CPU cgroups support to use the newer and integrated ResourceHandler mechanism, and also deprecated the old LCEResourceHandler inteface hierarchy. Contributed by Varun Vasudev. 
(cherry picked from commit 2085e60a9655b59aa2ba8917acdc511ab71ff6e4)
 2016-01-25 16:22:47 -08:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
97f6cfa94b Release process for 2.7.2: Set the release date for 2.7.2 
(cherry picked from commit ec4d2d9f40c1cb52ca4561b3d010ffc046a73495)
 2016-01-25 15:47:02 -08:00
Jian He
2d236c9de2 YARN-4520. Finished app info is unnecessarily persisted in NM state-store if container is acquired but not lunched on this node. Contributed by sandflee 2016-01-25 15:36:40 -08:00
Arpit Agarwal
0dbaef4377 HDFS-9094. Add command line option to ask NameNode reload configuration. (Contributed by Xiaobing Zhou) 2016-01-25 12:16:45 -08:00
Walter Su
75b83af20e HADOOP-12715. TestValueQueue#testgetAtMostPolicyALL fails intermittently. Contributed by Xiao Chen. 
(cherry picked from commit 6eacdea0e475b4fff91cedce5005a7c11749cf64)
 2016-01-25 19:42:56 +08:00
Akira Ajisaka
02d4a1fce3 YARN-4592. Remove unused GetContainerStatus proto. Contributed by Chang Li. 
(cherry picked from commit 56a0c175082b2b62698f65c1769a64224b3fb821)
 2016-01-25 15:20:45 +09:00
Akira Ajisaka
38ec290455 HADOOP-12736. TestTimedOutTestsListener#testThreadDumpAndDeadlocks sometimes times out. Contributed by Xiao Chen. 
(cherry picked from commit 643227927a7d7974655627d7e97aae42600692ae)
 2016-01-25 13:59:48 +09:00
Akira Ajisaka
4edd7bd820 HADOOP-12731. Remove useless boxing/unboxing code. Contributed by Kousuke Saruta. 
(cherry picked from commit 736eb17a796a1c1ad5f4db2c6a64f6752db7bec3)
 2016-01-25 13:48:28 +09:00
Akira Ajisaka
a9386cae6e MAPREDUCE-6614. Remove unnecessary code in TestMapreduceConfigFields. Contributed by Kai Sasaki. 2016-01-25 11:39:42 +09:00
Eric Yang
da61953a0b HDFS-9653. Added blocks pending deletion report to dfsadmin. 
(Weiwei Yang via eyang)
 2016-01-24 14:26:46 -08:00
rohithsharmaks
7e66b2f22c YARN-4613. Fix test failure in TestClientRMService#testGetClusterNodes. (Takashi Ohnishi via rohithsharmaks) 
(cherry picked from commit 10dc2c049304671f0ed9fd737a30cd843427b53e)
 2016-01-24 23:37:11 +05:30
rohithsharmaks
280c9b8401 YARN-4614. Fix random failure in TestApplicationPriority#testApplicationPriorityAllocationWithChangeInPriority. (Sunil G via rohithsharmaks) 
(cherry picked from commit 99829eb221482928d8a1b148ae3c802cc7c9253e)
 2016-01-23 07:58:16 +05:30
Xuan
1d19557dda YARN-4496. Improve HA ResourceManager Failover detection on the client. 
Contributed by Jian He

(cherry picked from commit 618bfd6ac2a5b62d39e9bed80f75362bafc0ef28)
 2016-01-22 18:21:50 -08:00
Jason Lowe
635849fa45 YARN-4598. Invalid event: RESOURCE_FAILED at CONTAINER_CLEANEDUP_AFTER_KILL. Contributed by tangshangwen 
(cherry picked from commit 46e5ea81e0e41646ba02391aea31481ead28aaf8)
 2016-01-22 21:55:59 +00:00
Jason Lowe
ad84f90e88 YARN-4371. "yarn application -kill" should take multiple application ids. Contributed by Sunil G 
(cherry picked from commit e91e8b711c68273460b36557fc37fdfc86be097b)
 2016-01-22 21:37:08 +00:00
rohithsharmaks
1cec12d95a YARN-4574. Fix random failure in TestAMRMClientOnRMRestart. (Takashi Ohnishi via rohithsharmaks) 
(cherry picked from commit 34a3900773df6d9075dcf5476e8fe5208cd8f806)
 2016-01-22 21:18:42 +05:30
Kihwal Lee
b5db1d4410 HDFS-8898. Create API and command-line argument to get quota and quota usage without detailed content summary. Contributed by Ming Ma. 2016-01-22 09:19:23 -06:00
rohithsharmaks
493275b27b YARN-4497. RM might fail to restart when recovering apps whose attempts are missing. (Jun Gong via rohithsharmaks) 
(cherry picked from commit d6258b33a7428a0725ead96bc43f4dd444c7c8f1)
 2016-01-22 20:29:10 +05:30
Akira Ajisaka
6368d102b9 HADOOP-12730. Hadoop streaming -mapper and -reducer options are wrongly documented as required. Contributed by Kengo Seki. 
(cherry picked from commit 0bae506c221f9736d08a6fba00ce5a862ab43cce)
 2016-01-22 21:09:09 +09:00
Akira Ajisaka
4fe28a644e HDFS-9682. Fix a typo "aplication" in HttpFS document. Contributed by Weiwei yang. 
(cherry picked from commit 683163468219107afb57a002f2cf2a369442171d)
 2016-01-22 20:12:39 +09:00
Akira Ajisaka
ddc22bbcb1 YARN-4605. Spelling mistake in the help message of "yarn applicationattempt" command. Contributed by Weiwei Yang. 
(cherry picked from commit 8f58f742aea87b2b46b9741ffeaebfa36af3573f)
 2016-01-22 19:43:37 +09:00
Akira Ajisaka
7f215ffdd5 MAPREDUCE-6605. Fix typos mapreduce.map.skip.proc.count.autoincr and mapreduce.reduce.skip.proc.count.autoincr in mapred-default.xml. Contributed by Kai Sasaki. 2016-01-22 18:37:17 +09:00
Varun Vasudev
85561207f9 YARN-4578. Directories that are mounted in docker containers need to be more restrictive/container-specific. Contributed by Sidharta Seethana. 
(cherry picked from commit b41a7e89d1eb8650975ac7092532ed9563ac60f2)
 2016-01-22 14:44:22 +05:30
Masatake Iwasaki
73ef77c12f HDFS-9618. Fix mismatch between log level and guard in BlockManager#computeRecoveryWorkForBlocks (iwasakims) 2016-01-22 14:12:06 +09:00
Rohith Sharma K S
844a8e3771 YARN-4584. RM startup failure when AM attempts greater than max-attempts. (Bibin A Chundatt via rohithsharmaks) 
(cherry picked from commit e30668106dc246f68db36fbd1f2db6ec08cd96f2)
 2016-01-22 10:20:09 +05:30
Masatake Iwasaki
245c3728ef HDFS-9601. NNThroughputBenchmark.BlockReportStats should handle NotReplicatedYetException on adding block (iwasakims) 2016-01-22 12:39:39 +09:00
Xiaoyu Yao
4d9efaf3b0 HADOOP-12659. Incorrect usage of config parameters in token manager of KMS. Contributed by Mingliang Liu. 
(cherry picked from commit f3427d3766d7101d0d1c37d6281918551d221ebe)
 2016-01-21 13:55:42 -08:00
Zhe Zhang
22caeb1c0a HDFS-9674. The HTrace span for OpWriteBlock should record the maxWriteToDisk time. Contributed by Colin McCabe. 
Change-Id: I9bf3f3bcd57f5880189ad7c160f3dd66f97d904b
 2016-01-21 13:26:54 -08:00
Jing Zhao
c19bdc1926 HDFS-9542. Move BlockIdManager from FSNamesystem to BlockManager. Contributed by Jing Zhao. 
(cherry picked from commit c304890c8c7782d835896859f5b7f60b96c306c0)
 2016-01-21 11:37:24 -08:00
Jason Lowe
d051200a62 YARN-4610. Reservations continue looking for one app causes other apps to starve. Contributed by Jason Lowe 
(cherry picked from commit 468a53b22f4ac5bb079dff986ba849a687d709fe)
 2016-01-21 18:32:47 +00:00
Akira Ajisaka
cd5c66b080 HADOOP-7161. Remove unnecessary oro package from dependency management section. Contributed by Sean Busbey. 
(cherry picked from commit 2ac39ca762fd7e47b7b9a7b3308b31138b0f59be)
 2016-01-22 02:45:54 +09:00
Akira Ajisaka
bf4901c609 YARN-4608. Redundant code statement in WritingYarnApplications. Contributed by Kai Sasaki. 
(cherry picked from commit d3224e2d6274daf73a103c0dbe21ba69add7ca26)
 2016-01-22 02:14:53 +09:00
Karthik Kambatla
5c2f495fcc YARN-4603. FairScheduler should mention user requested queuename in error message when failed in queue ACL check. (Tao Jie via kasha) 
(cherry picked from commit 4992398aeeb213ce59e068b0226e22e49ce559eb)
 2016-01-21 17:43:49 +01:00
Jason Lowe
4e6fc3ca18 YARN-4492. Add documentation for preemption supported in Capacity scheduler. Contributed by Naganarasimha G R 
(cherry picked from commit f858ac24269c101bdee1f7b7b2566bdbda2b4ecd)
 2016-01-21 15:39:51 +00:00
Kihwal Lee
3d8d8f1497 HDFS-9634. webhdfs client side exceptions don't provide enough details. Contributed by Eric Payne. 
(cherry picked from commit 7b70500484574a565dd8cd5c7d8b5bc7c6d91154)
 2016-01-21 09:33:30 -06:00
Vinayakumar B
c13929b385 HADOOP-12423. Handle failure of registering shutdownhook by ShutdownHookManager in static block (Contributed by Abhishek Agarwal) 
(cherry picked from commit 446987e20aacd870e1bc3f950b2bd4bbda1f9571)
 2016-01-21 20:10:11 +05:30
Vinayakumar B
845acfd96c HDFS-9625. set replication for empty file failed when set storage policy (Contributed by DENG FEI) 
(cherry picked from commit b7372b7166a13111b98794602ca4c166dfd78d29)
 2016-01-21 19:18:36 +05:30
Masatake Iwasaki
54df2a4352 HADOOP-12605. Fix intermittent failure of TestIPC.testIpcWithReaderQueuing (iwasakims) 
(cherry picked from commit 9eec6cbedcc53e6dd306a4a578a22937ae239260)
 2016-01-21 18:17:03 +09:00
Wangda Tan
9512866740 YARN-4557. Fix improper Queues sorting in PartitionedQueueComparator when accessible-node-labels=*. (Naganarasimha G R via wangda) 
(cherry picked from commit c9fe0371a8ab40c0d3437fadd32788b320788a7a)
 2016-01-21 11:16:58 +08:00
Xuan
66b030f608 YARN-4611. Fix scheduler load simulator to support multi-layer network 
location. Contributed by Ming Ma.

(cherry picked from commit 1708a4cd2377c56e2cb5738720b7eaf10baf13c8)
 2016-01-20 15:43:02 -08:00
Xuan
be3322792f YARN-4559. Make leader elector and zk store share the same curator 
client. Contributed by Jian He

(cherry picked from commit 890a2ebd1af51d24ccbbc5d1d65d17b24ad8ab9b)
 2016-01-20 14:49:04 -08:00
Lei Xu
c57f55223c HDFS-9655. NN should start JVM pause monitor before loading fsimage. (John Zhuge via Lei (Eddy) Xu) 
(cherry picked from commit 2ec438e8f7cd77cb48fd1264781e60a48e331908)
 2016-01-20 14:26:47 -08:00
Colin Patrick Mccabe
c56044b9ee HDFS-9576: HTrace: collect position/length information on read operations (zhz via cmccabe) 
(cherry picked from commit 7905788db94d560e6668af0d4bed22b326961aaf)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/DFSClient.java
 2016-01-20 11:27:51 -08:00