Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
10,645 Commits 326 Branches 371 Tags
Commit Graph

10645 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Junping Du
801ce47e28 MAPREDUCE-6508. TestNetworkedJob fails consistently due to delegation token changes on RM. Contributed by Akira AJISAKA 
(cherry picked from commit eb6379ca25e1bb6d3978bd3a021723c38c95bec9)
 2015-10-23 10:07:41 -07:00
Jonathan Eagles
6db7bfbcfd YARN-4009. CORS support for ResourceManager REST API. ( Varun Vasudev via jeagles) 
(cherry picked from commit f8adeb712dc834c27cec15c04a986f2f635aba83)
 2015-10-23 10:43:59 -05:00
Ming Ma
4bb7e68eb6 YARN-2913. Fair scheduler should have ability to set MaxResourceDefault for each queue. (Siqi Li via mingma) 
(cherry picked from commit 934d96a334598fcf0e5aba2043ff539469025f69)
 2015-10-23 08:37:46 -07:00
Tsuyoshi Ozawa
de739cabb1 HADOOP-7266. Deprecate metrics v1. Contributed by Akira AJISAKA. 
(cherry picked from commit 35a303dfbe348f96c465fb8778ced6b5bb617e89)
 2015-10-23 23:48:36 +09:00
cnauroth
4ee8297c89 HDFS-9286. HttpFs does not parse ACL syntax correctly for operation REMOVEACLENTRIES. Contributed by Wei-Chiu Chuang. 
(cherry picked from commit 124a412a3711bd42eaeebe531376004c739a15d6)
 2015-10-22 15:25:30 -07:00
Tsuyoshi Ozawa
525a67a62e HADOOP-9692. Improving log message when SequenceFile reader throws EOFException on zero-length file. (Zhe Zhang and Chu Tong via ozawa) 2015-10-23 06:54:24 +09:00
Tsuyoshi Ozawa
7d4246a5da Revert "HADOOP-9692. Improving log message when SequenceFile reader throws EOFException on zero-length file. Contributed by Zhe Zhang and Chu Tong." 
This reverts commit 3ed9db0a385719e44f6bb4c9aaa42a371af65e2a.
 2015-10-23 06:53:56 +09:00
cnauroth
b023539c19 HADOOP-12484. Single File Rename Throws Incorrectly In Potential Race Condition Scenarios. Contributed by Gaurav Kanade. 
(cherry picked from commit cb282d5b89fdece4719cc4ad37a6e27f13371534)
 2015-10-22 14:30:09 -07:00
Junping Du
d5145b58f6 YARN-4243. Add retry on establishing Zookeeper conenction in EmbeddedElectorService#serviceInit. Contributed by Xuan Gong. 
(cherry picked from commit 0fce5f9a496925f0d53ea6c14318c9b513de9882)
 2015-10-22 13:42:12 -07:00
Zhihai Xu
9fe7ccc61c YARN-4256. YARN fair scheduler vcores with decimal values. Contributed by Jun Gong 
(cherry picked from commit 960201b79b9f2ca40f8eadb21a2f9fe37dde2b5d)
 2015-10-22 12:31:28 -07:00
cnauroth
10398daadf HADOOP-12334. Change Mode Of Copy Operation of HBase WAL Archiving to bypass Azure Storage Throttling after retries. Contributed by Gaurav Kanade. 
(cherry picked from commit 47641fcbc9c41f4a338d8899501e4a310d2e81ad)
 2015-10-22 12:21:44 -07:00
Zhe Zhang
a9deeb96b2 HDFS-9280. Document NFS gateway export point parameter. Contributed by Xiao Chen. 
Change-Id: I1cea610c31301d793db3c9ca4dae86d0e5d2d64b
 2015-10-22 11:40:09 -07:00
Anubhav Dhoot
c44401f362 YARN-3739. Add reservation system recovery to RM recovery process. Contributed by Subru Krishnan. 
(cherry picked from commit 2798723a5443d04455b9d79c48d61f435ab52267)
 2015-10-22 06:52:41 -07:00
Tsuyoshi Ozawa
3ed9db0a38 HADOOP-9692. Improving log message when SequenceFile reader throws EOFException on zero-length file. Contributed by Zhe Zhang and Chu Tong. 
(cherry picked from commit 381610da620121c02073dbbaac669b80b41959b4)
 2015-10-22 11:59:25 +09:00
yliu
7579ec5bf5 HDFS-7087. Ability to list /.reserved. (Xiao Chen via wang) 2015-10-22 10:42:18 +08:00
yliu
2d577115a5 Revert "HDFS-7087. Ability to list /.reserved. Contributed by Xiao Chen." 
This reverts commit ed731f79d99a4bc0ec14626f8448612d1edc4d9a.
 2015-10-22 10:16:49 +08:00
Andrew Wang
ed731f79d9 HDFS-7087. Ability to list /.reserved. Contributed by Xiao Chen. 
(cherry picked from commit 3dadf369d550c2ae393b751cb5a184dbfe2814df)
 2015-10-21 16:58:50 -07:00
cnauroth
faf1c60899 HDFS-9273. ACLs on root directory may be lost after NN restart. Contributed by Xiao Chen. 
(cherry picked from commit 1b525a9c32fabd8919c80717a58afbfa7fdce27e)
 2015-10-21 16:39:13 -07:00
Andrew Wang
7a9b97e6b7 HADOOP-10406. TestIPC.testIpcWithReaderQueuing may fail. Contributed by Xiao Chen. 
(cherry picked from commit d1cdce77faba1a9a69fe7894ecec937d2975499b)
 2015-10-21 15:21:15 -07:00
Andrew Wang
378cb17057 HDFS-9225. Fix intermittent test failure of TestBlockManager.testBlocksAreNotUnderreplicatedInSingleRack. Contributed by Masatake Iwasaki. 
(cherry picked from commit 3e50f478b9f40fccd7b22f8fbd95d2bfda7867d2)
 2015-10-21 14:55:34 -07:00
Jason Lowe
7c002e2416 MAPREDUCE-6518. Set SO_KEEPALIVE on shuffle connections. Contributed by Chang Li 
(cherry picked from commit ee9b80acf84718b952cbb82380cd0a4dbe22dc79)
 2015-10-21 21:45:51 +00:00
Zhe Zhang
2e55226ef5 HDFS-9274. Default value of dfs.datanode.directoryscan.throttle.limit.ms.per.sec should be consistent. Contributed by Yi Liu. 
Change-Id: Iafa2efb8f2eafd193b417690cc8794080b9d745b
 2015-10-21 14:07:08 -07:00
Jonathan Eagles
cc8093e5ac YARN-2513. Host framework UIs in YARN for use with the ATS (jeagles) 
(cherry picked from commit 25f8f801d15e3d9f27f4a2a198262407203e14a5)
 2015-10-21 15:38:48 -05:00
Ming Ma
39e7548cd9 HDFS-8647. Abstract BlockManager's rack policy into BlockPlacementPolicy. (Brahma Reddy Battula via mingma) 
(cherry picked from commit e27c2ae8bafc94f18eb38f5d839dcef5652d424e)
 2015-10-21 08:24:02 -07:00
Tsuyoshi Ozawa
e2f027dddc Moved CHANGES.txt entries to 2.6.2 
YARN-2019, YARN-4092, YARN-4101, YARN-4087, YARN-3727, YARN-4005,
YARN-3780, YARN-3802, YARN-3896, YARN-3554, YARN-3194, YARN-3798

(cherry picked from commit 14f0e2787c7c590d8ec1fc52f437866f34b098bd)
 2015-10-21 23:25:43 +09:00
Jason Lowe
be72ed1c75 MAPREDUCE-6489. Fail fast rogue tasks that write too much to local disk. Contributed by Maysam Yabandeh 2015-10-21 14:11:48 +00:00
Andrew Wang
cb19552fb1 HDFS-3059. ssl-server.xml causes NullPointer. Contributed by Xiao Chen. 2015-10-20 18:00:20 -07:00
Robert Kanter
492142097b MAPREDUCE-6495. Docs for archive-logs tool (rkanter) 
(cherry picked from commit 0c4af0f99811a7138954391df3761aef9ff09155)
 2015-10-20 17:34:56 -07:00
Arun Suresh
f2009dc89c YARN-3985. Make ReservationSystem persist state using RMStateStore reservation APIs. (adhoot via asuresh) 
(cherry picked from commit 506d1b1dbcb7ae5dad4a3dc4d415af241c72887c)
 2015-10-20 16:48:58 -07:00
Kihwal Lee
e327233e80 HADOOP-12418. TestRPC.testRPCInterruptedSimple fails intermittently. Contributed Kihwal Lee. 
(cherry picked from commit 01b103f4ff2e8ee7e71d082885436c5cb7c6be0b)

Conflicts:
	hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/ipc/TestRPC.java
 2015-10-20 15:19:01 -05:00
Colin Patrick Mccabe
1a4bd5b161 HDFS-9270. TestShortCircuitLocalRead should not leave socket after unit test (Masatake Iwasaki via Colin P. McCabe) 
(cherry picked from commit 6381ddc096699d680233db3b9efff9321528eedc)
 2015-10-20 10:57:16 -07:00
Lei Xu
7a8ed154ac HDFS-9251. Refactor TestWriteToReplica and TestFsDatasetImpl to avoid explicitly creating Files in the tests code. (lei) 
(cherry picked from commit 71e533a153cbe547c99d2bc18c4cd8b7da9b00b7)
 2015-10-20 10:09:16 -07:00
yliu
03bb40612e HDFS-9208. Disabling atime may fail clients like distCp. (Kihwal Lee via yliu) 2015-10-20 11:31:14 +08:00
Arun Suresh
acc0e718d6 YARN-4270. Limit application resource reservation on nodes for non-node/rack specific requests (asuresh) 
(cherry picked from commit 7e2837f830382835838c82398db6fc9823d612a7)
 2015-10-19 20:02:10 -07:00
Andrew Wang
c35771c46e HDFS-9250. Add Precondition check to LocatedBlock#addCachedLoc. Contributed by Xiao Chen. 
(cherry picked from commit 8175c4f6b9fc17ff2e0fc568d798f9b6f2487696)
 2015-10-19 16:13:14 -07:00
Kihwal Lee
e86819c91f HADOOP-12464. Interrupted client may try to fail-over and retry. Contributed by Kihwal Lee. 
(cherry picked from commit 6144e0137bb51bd04b46ea5ce42c59c2d4f7657d)
 2015-10-19 10:56:19 -05:00
Varun Vasudev
e4429de86f YARN-4267. Add additional logging to container launch implementations in container-executor. Contributed by Sidharta Seethana. 
(cherry picked from commit 151eab2a12f5a08c00f04803bf18ef8298b98e66)
 2015-10-19 20:56:43 +05:30
Varun Vasudev
196d549e2b YARN-4262. Allow whitelisted users to run privileged docker containers. Contributed by Sidharta Seethana. 
(cherry picked from commit e39ae0e676f77fab216e2281ae946ab8c647733f)
 2015-10-19 20:21:48 +05:30
Vinayakumar B
b6dce3834d HADOOP-12460. Add overwrite option for 'get' shell command (Contributed by Jagadesh Kiran N) 
(cherry picked from commit 7f0e1eb43d3fb173e3c7932739ef20095e28ed7b)
 2015-10-19 12:16:44 +05:30
Tsuyoshi Ozawa
23bd017a7b HDFS-9237. NPE at TestDataNodeVolumeFailureToleration#tearDown. Contributed by Brahma Reddy Battula. 
(cherry picked from commit 4c9c3955ae6cb5c3b67c8127eb7fa5449a0286d9)
 2015-10-19 15:30:37 +09:00
yliu
2c0dbf728a HADOOP-12483. Maintain wrapped SASL ordering for postponed IPC responses. (Daryn Sharp via yliu) 2015-10-19 09:52:39 +08:00
Steve Loughran
f7d746a81b HADOOP-10941. Proxy user verification NPEs if remote host is unresolvable (Benoy Antony via stevel). 2015-10-18 14:05:17 +01:00
Steve Loughran
b390aae467 HADOOP-12450. UserGroupInformation should not log at WARN level if no groups are found. (Elliott Clark via stevel) 2015-10-18 12:23:34 +01:00
Steve Loughran
390f29ab99 YARN-4155. TestLogAggregationService.testLogAggregationServiceWithInterval failing. (Bibin A Chundatt via stevel) 2015-10-18 12:03:46 +01:00
Steve Loughran
10932aad29 HADOOP-11628. SPNEGO auth does not work with CNAMEs in JDK8. (Daryn Sharp via stevel). 2015-10-18 11:45:11 +01:00
Sangjin Lee
180efe6677 YARN-2556. Tool to measure the performance of the timeline server (Chang Li via sjlee) 
(cherry picked from commit 58590fef49bf45fc97c81277560e08da6b753f95)
 2015-10-16 16:57:32 -07:00
Jian He
1ba73169c7 YARN-4170. AM need to be notified with priority in AllocateResponse. Contributed by Sunil G 
(cherry picked from commit f9da5cdb2b2dd071fd60fc01ea1edf0f79c0819b)
 2015-10-16 15:26:46 -07:00
Wangda Tan
204ee6a40f YARN-4162. CapacityScheduler: Add resource usage by partition and queue capacity by partition to REST API. (Naganarasimha G R via wangda) 
(cherry picked from commit 4337b263aa23464a01c316336db2319e2858a2b3)
 2015-10-16 15:10:08 -07:00
Haohui Mai
842b3324f2 HDFS-9253. Refactor tests of libhdfs into a directory. Contributed by Haohui Mai. 2015-10-16 11:20:39 -07:00
Tsz-Wo Nicholas Sze
32c810c819 HDFS-9205. Do not schedule corrupt blocks for replication. (szetszwo) 2015-10-16 23:15:16 +08:00