Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
8,047 Commits 326 Branches 371 Tags
Commit Graph

8047 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Tsuyoshi Ozawa
4ca49c8634 YARN-2988. Graph#save() may leak file descriptors. (Ted Yu via ozawa) 2014-12-25 13:09:51 +09:00
Jian He
60530a6c4f YARN-2946. Fixed potential deadlock in RMStateStore. Contributed by Rohith Sharmaks 
(cherry picked from commit 4f18018b7abb405f38d269da096ec9fd80c81d9a)
 2014-12-23 22:15:28 -08:00
Zhijie Shen
f02bd6683a YARN-2937. Fixed new findbugs warnings in hadoop-yarn-nodemanager. Contributed by Varun Saxena. 
(cherry picked from commit 41a548a916d4248164cb9495320f123ec215d70e)
 2014-12-23 20:35:32 -08:00
Junping Du
361fab14be YARN-2940. Fix new findbugs warnings in rest of the hadoop-yarn components. (Contributed by Li Lu) 
(cherry picked from commit d468c9aaf15e977f12e6214b47996412c907e069)
 2014-12-23 20:06:53 -08:00
Jian He
e3a54b1b8b YARN-2837. Support TimeLine server to recover delegation token when restarting. Contributed by Zhijie Shen 
(cherry picked from commit 149512a83743715bb100feb6747b7e88301018ab)
 2014-12-23 18:26:37 -08:00
Junping Du
ae3faab13e YARN-2970. NodeLabel operations in RMAdmin CLI get missing in help command. (Contributed by Varun Saxena) 
(cherry picked from commit e1ee0d45ea3315e7fbe1d28a7a35a0ce0c54483b)
 2014-12-23 18:24:45 -08:00
Robert Kanter
653b3fada2 HADOOP-11399. Java Configuration file and .xml files should be automatically cross-compared (rchiang via rkanter) 
(cherry picked from commit 66cfe1dc73af1f8e3accebb1fa4c1bde19c78b0e)
 2014-12-23 14:31:07 -08:00
Jing Zhao
9aa9455dab HDFS-7484. Make FSDirectory#addINode take existing INodes as its parameter. Contributed by Jing Zhao. 2014-12-22 23:20:18 -08:00
Vinayakumar B
cd8e78d50f HDFS-7456. De-duplicate AclFeature instances with same AclEntries do reduce memory footprint of NameNode (Contributed by Vinayakumar B) 
(cherry picked from commit 50ae1a6664a92619aa683d2a864d0da9fb4af026)
 2014-12-23 12:37:16 +05:30
Jian He
8b398a66ca YARN-2340. Fixed NPE when queue is stopped during RM restart. Contributed by Rohith Sharmaks 
(cherry picked from commit 0d89859b51157078cc504ac81dc8aa75ce6b1782)
 2014-12-22 21:55:06 -08:00
Jian He
411836b74c YARN-2920. Changed CapacityScheduler to kill containers on nodes where node labels are changed. Contributed by Wangda Tan 
(cherry picked from commit fdf042dfffa4d2474e3cac86cfb8fe9ee4648beb)
 2014-12-22 16:52:15 -08:00
cnauroth
5486124668 HDFS-7560. ACLs removed by removeDefaultAcl() will be back after NameNode restart/failover. Contributed by Vinayakumar B. 
(cherry picked from commit 2cf90a2c338497a466bbad9e83966033bf14bfb7)
 2014-12-22 14:02:49 -08:00
Junping Du
6f252f7f36 YARN-2939. Fix new findbugs warnings in hadoop-yarn-common. (Li Lu via junping_du) 
(cherry picked from commit a696fbb001b946ae75f3b8e962839c2fd3decfa1)
 2014-12-22 03:08:25 -08:00
Tsuyoshi Ozawa
370a137c19 HADOOP-11414. FileBasedIPList#readLines() can leak file descriptors. (ozawa) 
(cherry picked from commit ecf1469fa51f9977f70652fac313d4a9ec1eb86f)
 2014-12-22 13:10:46 +09:00
yliu
7e49c99ead HDFS-7557. Fix spacing for a few keys in DFSConfigKeys.java (Colin P. McCabe) 2014-12-22 00:57:18 +08:00
Haohui Mai
e6662ec6a4 HADOOP-11429. Findbugs warnings in hadoop extras. Contributed by Varun Saxena. 2014-12-21 14:57:41 -08:00
Haohui Mai
db2984b044 HDFS-7555. Remove the support of unmanaged connectors in HttpServer2. Contributed by Haohui Mai. 2014-12-21 14:50:42 -08:00
Tsuyoshi Ozawa
d5d13bbe0f CHANGES.txt: move YARN-2977 from 2.6.1 to 2.7.0 2014-12-21 12:53:25 +09:00
Karthik Kambatla
2abec14ec6 YARN-2975. FSLeafQueue app lists are accessed without required locks. (kasha) 
(cherry picked from commit 24ee9e3431d27811530ffa01d8d241133fd643fe)
 2014-12-20 12:20:29 -08:00
Tsuyoshi Ozawa
7b6a0badc2 CHANGES.txt: add YARN-2977 2014-12-20 22:57:58 +09:00
Tsuyoshi Ozawa
31753da961 YARN-2977. Fixed intermittent TestNMClient failure. (Contributed by Junping Du) 2014-12-20 22:43:47 +09:00
arp
0a5b28605f HADOOP-11395. Add site documentation for Azure Storage FileSystem integration. (Contributed by Chris Nauroth) 2014-12-19 18:54:35 -08:00
Jian He
9180d11b3b YARN-2952. Fixed incorrect version check in StateStore. Contributed by Rohith Sharmaks 
(cherry picked from commit 808cba3821d5bc4267f69d14220757f01cd55715)
 2014-12-19 16:56:55 -08:00
Karthik Kambatla
b4e8ae591d YARN-2675. containersKilled metrics is not updated when the container is killed during localization. (Zhihai Xu via kasha) 
(cherry picked from commit 954fb8581ec6d7d389ac5d6f94061760a29bc309)
 2014-12-19 16:03:02 -08:00
Robert Kanter
f9341c1e2c MAPREDUCE-6199. AbstractCounters are not reset completely on deserialization (adhoot via rkanter) 
(cherry picked from commit 390a7c12f543b2c94a74f08d6d2a28410472043a)
 2014-12-19 15:44:01 -08:00
Karthik Kambatla
8ee40a1580 YARN-2738. [YARN-2574] Add FairReservationSystem for FairScheduler. (Anubhav Dhoot via kasha) 
(cherry picked from commit a22ffc318801698e86cd0e316b4824015f2486ac)
 2014-12-19 15:38:27 -08:00
Karthik Kambatla
e6c73a1c1a HADOOP-11213. Typos in html pages: SecureMode and EncryptedShuffle. (Wei Yan via kasha) 
(cherry picked from commit 6f1e3667cff3e95f33ba14a3cb7d1e99518d502a)
 2014-12-19 15:07:39 -08:00
Colin Patrick Mccabe
bcaf15e2fa HDFS-7443. Datanode upgrade to BLOCKID_BASED_LAYOUT fails if duplicate block files are present in the same volume (cmccabe) 
(cherry picked from commit 8fa265a290792ff42635ff9b42416c634f88bdf3)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/DataStorage.java
 2014-12-19 13:19:52 -08:00
Colin Patrick Mccabe
c60e3bdc4b HADOOP-11422. Check CryptoCodec is AES-CTR for Crypto input/output stream (Yi Liu via Colin P. McCabe) 
(cherry picked from commit e369d98ba24906abcb35c0906cd57750c0d21fdb)
 2014-12-19 13:12:20 -08:00
Robert Kanter
22b38cf29a MAPREDUCE-6045. need close the DataInputStream after open it in TestMapReduce.java (zxu via rkanter) 
(cherry picked from commit d9e4d67d18811e16d5b0a76ea8228d333ded195f)
 2014-12-19 12:00:00 -08:00
Colin Patrick Mccabe
22f72c7946 HDFS-7552. Change FsVolumeList toString() to fix TestDataNodeVolumeFailureToleration (Liang Xie via Colin P. McCabe) 
(cherry picked from commit a4876c130f1627e59ef055e586640d1933fc49af)
 2014-12-19 11:20:43 -08:00
Colin Patrick Mccabe
fe38ed2ee7 HADOOP-11430. Add GenericTestUtils#disableLog, GenericTestUtils#setLogLevel (cmccabe) 
(cherry picked from commit 6635ccd21766faf8f6a15d937dc8919a9075c988)
 2014-12-18 19:41:59 -08:00
Haohui Mai
99c176ea6a HADOOP-11431. Clean up redundant maven-site-plugin configuration. Contributed by Herve Boutemy. 2014-12-18 16:24:17 -08:00
Jason Lowe
173664d70f YARN-2964. RM prematurely cancels tokens for jobs that submit jobs (oozie). Contributed by Jian He 
(cherry picked from commit 0402bada1989258ecbfdc437cb339322a1f55a97)
 2014-12-18 23:31:11 +00:00
cnauroth
947475c127 HDFS-7431. log message for InvalidMagicNumberException may be incorrect. Contributed by Yi Liu. 
(cherry picked from commit 5df7ecb33ab24de903f0fd98e2a055164874def5)
 2014-12-18 15:06:00 -08:00
Andrew Wang
8d98d87745 HDFS-7530. Allow renaming of encryption zone roots. Contributed by Charles Lamb. 
(cherry picked from commit b0b9084433d5e80131429e6e76858b099deb2dda)
 2014-12-18 14:18:14 -08:00
Haohui Mai
27ef6e4a6e HADOOP-11428. Remove obsolete reference to Cygwin in BUILDING.txt. Contributed by Arpit Agarwal. 2014-12-18 13:38:15 -08:00
Jason Lowe
84ea92879c HADOOP-11409. FileContext.getFileContext can stack overflow if default fs misconfigured. Contributed by Gera Shegalov 
(cherry picked from commit b9d49761f72078a0a83137ba8197d08b71f385e0)
 2014-12-18 21:28:57 +00:00
Haohui Mai
a508001ddd HADOOP-11385. Prevent cross site scripting attack on JMXJSONServlet. Contributed by Haohui Mai. 2014-12-18 11:39:17 -08:00
Haohui Mai
b1703c5c8f HDFS-7543. Avoid path resolution when getting FileStatus for audit logs. Contributed by Haohui Mai. 2014-12-18 11:25:03 -08:00
Colin Patrick Mccabe
2743b94c27 HADOOP-11427. ChunkedArrayList: fix removal via iterator and implement get (cmccabe) 
(cherry picked from commit 07619aa516deb9094a18e0c64ce66ff9c8b05e92)
 2014-12-18 11:05:33 -08:00
Kihwal Lee
8bffaa46fc HDFS-7373. Clean up temporary files after fsimage transfer failures. Contributed by Kihwal Lee 
(cherry picked from commit c0d666c74e9ea76564a2458c6c0a78ae7afa9fea)
 2014-12-18 13:00:18 -06:00
Haohui Mai
8854c78015 HADOOP-11125. Remove redundant tests in TestOsSecureRandom. Contributed by Masanori Oyama. 2014-12-18 10:59:48 -08:00
Junping Du
cec9300201 YARN-2949. Add documentation for CGroups. (Contributed by Varun Vasudev) 
(cherry picked from commit 389f881d423c1f7c2bb90ff521e59eb8c7d26214)
 2014-12-18 06:26:53 -08:00
yliu
2d1ddbe58e HADOOP-11358. Tests for encryption/decryption with IV calculation overflow. (yliu) 2014-12-18 00:43:31 +08:00
Junping Du
11e4ec52a1 YARN-2972. DelegationTokenRenewer thread pool never expands. Contributed by Jason Lowe 
(cherry picked from commit 2b4b0e8847048850206f091c6870a02e08cfe836)
 2014-12-17 17:41:21 -08:00
Colin Patrick Mccabe
dda1fc169d HDFS-7531. Improve the concurrent access on FsVolumeList (Lei Xu via Colin P. McCabe) 
(cherry picked from commit 3b173d95171d01ab55042b1162569d1cf14a8d43)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/FsDatasetImpl.java
 2014-12-17 16:43:33 -08:00
Karthik Kambatla
d0d42c4e32 YARN-2203. [YARN-1492] Web UI for cache manager. (Chris Trezzo via kasha) 
(cherry picked from commit b7f64823e11f745783607ae5f3f97b5e8e64c389)
 2014-12-17 16:34:33 -08:00
Karthik Kambatla
375a1e5971 YARN-2944. InMemorySCMStore can not be instantiated with ReflectionUtils#newInstance. (Chris Trezzo via kasha) 
(cherry picked from commit a1bd1409649da96c9fde4a9f9398d7711bc6c281)
 2014-12-17 16:25:02 -08:00
Karthik Kambatla
2d832ad2eb YARN-2964. FSLeafQueue#assignContainer - document the reason for using both write and read locks. (Tsuyoshi Ozawa via kasha) 
(cherry picked from commit f2d150ea1205b77a75c347ace667b4cd060aaf40)
 2014-12-17 16:24:17 -08:00