Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
8,845 Commits 326 Branches 371 Tags
Commit Graph

8845 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
yliu
991ac04afc HDFS-7838. Expose truncate API for libhdfs. (yliu) 2015-03-17 07:24:20 +08:00
Tsuyoshi Ozawa
77297017d8 HADOOP-11720. [JDK8] Fix javadoc errors caused by incorrect or illegal tags in hadoop-tools. Contributed by Akira AJISAKA. 
(cherry picked from commit ef9946cd52d54200c658987c1dbc3e6fce133f77)
 2015-03-17 16:09:38 +09:00
Tsuyoshi Ozawa
bb828565f8 MAPREDUCE-5755. MapTask.MapOutputBuffer#compare/swap should have @Override annotation. (ozawa) 
(cherry picked from commit bb243cea93b6872ef8956311a2290ca0b83ebb22)
 2015-03-17 14:55:33 +09:00
Harsh J
5e403e8b8d MAPREDUCE-6100. replace mapreduce.job.credentials.binary with MRJobConfig.MAPREDUCE_JOB_CREDENTIALS_BINARY for better readability. Contributed by Zhihai Xu. 
(cherry picked from commit f222bde273cc10a38945dc31e85206a0c4f06a12)
 2015-03-17 11:08:32 +05:30
Harsh J
cbb8858367 HDFS-2360. Ugly stacktrce when quota exceeds. (harsh) 
(cherry picked from commit 046521cd6511b7fc6d9478cb2bed90d8e75fca20)
 2015-03-17 10:28:52 +05:30
Ravi Prakash
9f227ad696 YARN-3339. TestDockerContainerExecutor should pull a single image and not the entire centos repository. (Ravindra Kumar Naik via raviprak) 
(cherry picked from commit 56085203c43b8f2561bf3745910e03f8ac176a67)
 2015-03-16 16:18:42 -07:00
Tsuyoshi Ozawa
a20427d339 YARN-3349. Treat all exceptions as failure in TestFSRMStateStore#testFSRMStateStoreClientRetry. Contributed by Zhihai Xu. 
(cherry picked from commit 7522a643faeea2d8a8e2c7409ae60e0973e7cf38)
 2015-03-17 08:10:12 +09:00
cnauroth
ef2a66b246 Revert "HADOOP-11449 / HADOOP-10320 ; reverting patch 6cda3a7 which triggered regression in javadocs on some java8 compilers (stevel on behalf of cnauroth)" 
This reverts commit fe7df5b4d87298571da45562402976810899b6a9.

Conflicts:
	hadoop-common-project/hadoop-annotations/src/main/java/org/apache/hadoop/classification/InterfaceStability.java
 2015-03-16 14:31:35 -07:00
Suresh Srinivas
3a783fe38d HADOOP-8059. Add javadoc to InterfaceAudience and InterfaceStability. Contributed by Brandon Li. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1354684 13f79535-47bb-0310-9956-ffa450edef68
(cherry picked from commit 24c4216bf0d75006fb218d743183f96658bea65c)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
 2015-03-16 14:21:15 -07:00
Yongjun Zhang
d684b21ada HADOOP-11692. Amendment to CHANGES.txt. 2015-03-16 14:11:58 -07:00
cnauroth
f492fc7b2c HADOOP-11638. OpensslSecureRandom.c pthreads_thread_id should support FreeBSD and Solaris in addition to Linux. Contributed by Kiran Kumar M R. 
(cherry picked from commit 72cd4e4a4eb2a9f8695d4c67eb55dd2be36c52dc)
 2015-03-16 14:05:05 -07:00
Harsh J
0e9f78dda2 MAPREDUCE-6105. nconsistent configuration in property mapreduce.reduce.shuffle.merge.percent. Contributed by Ray Chiang. 
(cherry picked from commit 26a23b11598b3757ed4973781890e2cd2fc270df)
 2015-03-17 02:27:33 +05:30
Konstantin V Shvachko
4568acaa62 HDFS-7886. Fix TestFileTruncate falures. Contributed by Plamen Jeliazkov and Konstantin Shvachko. 2015-03-16 12:55:16 -07:00
Harsh J
2684b0b440 MAPREDUCE-4414. Add main methods to JobConf and YarnConfiguration, for debug purposes. Contributed by Plamen Jeliazkov. 
(cherry picked from commit 571f75b468a4412be2178466cb5d3888b05cd076)
 2015-03-17 01:02:21 +05:30
Colin Patrick Mccabe
eb4eb63de3 HADOOP-11714. Add more trace log4j messages to SpanReceiverHost (cmccabe) 
(cherry picked from commit bf3275dbaa99105d49520e25f5a6eadd6fd5b7ed)
 2015-03-16 12:03:10 -07:00
Zhijie Shen
fbe811d904 YARN-2854. Updated the documentation of the timeline service and the generic history service. Contributed by Naganarasimha G R. 2015-03-16 10:52:32 -07:00
Tsuyoshi Ozawa
d6e3ef2506 YARN-1453. [JDK8] Fix Javadoc errors caused by incorrect or illegal tags in doc comments. Contributed by Akira AJISAKA, Andrew Purtell, and Allen Wittenauer. 
(cherry picked from commit 3da9a97cfbcc3a1c50aaf85b1a129d4d269cd5fd)
 2015-03-16 23:20:17 +09:00
Xuan
b6eb36dbdc YARN-3171. Sort by Application id, AppAttempt and ContainerID doesn't 
work in ATS / RM web ui. Contributed by Naganarasimha G R

(cherry picked from commit 3ff1ba2a7b00fdf06270d00b2193bde4b56b06b3)
 2015-03-15 20:27:44 -07:00
Colin Patrick Mccabe
c71b54fa32 HDFS-7915. The DataNode can sometimes allocate a ShortCircuitShm slot and fail to tell the DFSClient about it because of a network error (cmccabe) 
(cherry picked from commit bc9cb3e271b22069a15ca110cd60c860250aaab2)
 2015-03-14 22:41:50 -07:00
Tsuyoshi Ozawa
4489a02634 HADOOP-11558. Fix dead links to doc of hadoop-tools. Contributed by Jean-Pierre Matsumoto. 
(cherry picked from commit 79426f3334ade5850fbf169764f540ede00fe366)
 2015-03-15 14:30:12 +09:00
Tsuyoshi Ozawa
1802df8373 Revert "HADOOP-11558. Fix dead links to doc of hadoop-tools. Contributed by Masatake Iwasaki." 
This reverts commit 54a73a6b5fd085456020d3564187e03a0ef41033.
 2015-03-15 14:27:56 +09:00
Tsuyoshi Ozawa
54a73a6b5f HADOOP-11558. Fix dead links to doc of hadoop-tools. Contributed by Masatake Iwasaki. 
(cherry picked from commit 7da136ecca4dafc83ef69b5d9980fa5b67ada084)
 2015-03-15 14:18:01 +09:00
Tsuyoshi Ozawa
c5c544c1b7 Moving CHANGES.txt entry for MAPREDUCE-4742 to branch-2.7. 
(cherry picked from commit bd0a9ba8e3b1c75dd2fc4cc65cb00c3e31d609ce)
 2015-03-14 16:54:50 +09:00
Tsuyoshi Ozawa
10745fcecd MAPREDUCE-6265. Make ContainerLauncherImpl.INITIAL_POOL_SIZE configurable to better control to launch/kill containers. Contributed by Zhihai Xu 
(cherry picked from commit 9d38520c8e42530a817a7f69c9aa73a9ad40639c)

Conflicts:
	hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/resources/mapred-default.xml
 2015-03-14 16:45:23 +09:00
Colin Patrick Mccabe
f93a2dd94b Revert "HDFS-7915. The DataNode can sometimes allocate a ShortCircuitShm slot and fail to tell the DFSClient about it because of a network error (cmccabe)" (Jenkins didn't run yet) 
This reverts commit 7550052b85bc9b73eb94cedc708f682681679b45.
 2015-03-13 18:39:43 -07:00
Colin Patrick Mccabe
7550052b85 HDFS-7915. The DataNode can sometimes allocate a ShortCircuitShm slot and fail to tell the DFSClient about it because of a network error (cmccabe) 
(cherry picked from commit 5aa892ed486d42ae6b94c4866b92cd2b382ea640)
 2015-03-13 18:30:36 -07:00
Konstantin V Shvachko
8afbfed5d3 HDFS-2605. Remove redundant "Release 0.21.1" section from CHANGES.txt. Contributed by Allen Wittenauer. 2015-03-13 13:45:13 -07:00
Konstantin V Shvachko
b199081f54 HDFS-7903. Cannot recover block after truncate and delete snapshot. Contributed by Plamen Jeliazkov. 2015-03-13 12:40:38 -07:00
Kihwal Lee
464271a5ed HDFS-7435. PB encoding of block reports is very inefficient. Contributed by Daryn Sharp. 
(cherry picked from commit d324164a51a43d72c02567248bd9f0f12b244a40)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/FsDatasetImpl.java
 2015-03-13 14:36:34 -05:00
Brandon Li
af80a98ace HDFS-7926. NameNode implementation of ClientProtocol.truncate(..) is not idempotent. Contributed by Tsz Wo Nicholas Sze 
(cherry picked from commit f446669afb5c3d31a00c65449f27088b39e11ae3)
 2015-03-13 10:43:46 -07:00
Jonathan Eagles
44aedad5dd YARN-3267. Timelineserver applies the ACL rules after applying the limit on the number of records (Chang Li via jeagles) 
(cherry picked from commit 8180e676abb2bb500a48b3a0c0809d2a807ab235)
 2015-03-13 12:05:21 -05:00
Andrew Wang
146abadb96 HADOOP-11711. Provide a default value for AES/CTR/NoPadding CryptoCodec classes. 
(cherry picked from commit 387f271c81f7b3bf53bddc5368d5f4486530c2e1)
 2015-03-12 21:41:29 -07:00
yliu
813c93cb25 HADOOP-11710. Make CryptoOutputStream behave like DFSOutputStream wrt synchronization. (Sean Busbey via yliu) 2015-03-13 02:26:16 +08:00
Yongjun Zhang
32e62cb3d0 HADOOP-9477. Add posixGroups support for LDAP groups mapping service. (Dapeng Sun via Yongjun Zhang) 
(cherry picked from commit 82128774156c30a535b62d764bb6cf9c8d2f3a3b)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
 2015-03-12 15:10:20 -07:00
Vinod Kumar Vavilapalli
53aa3a4d1f YARN-3154. Added additional APIs in LogAggregationContext to avoid aggregating running logs of application when rolling is enabled. Contributed by Xuan Gong. 
(cherry picked from commit 863079bb874ba77918ca1c0741eae10e245995c8)
 2015-03-12 13:33:42 -07:00
Colin Patrick Mccabe
7455412a24 HDFS-7722. DataNode#checkDiskError should also remove Storage when error is found. (Lei Xu via Colin P. McCabe) 
(cherry picked from commit b49c3a1813aa8c5b05fe6c02a653286c573137ca)
 2015-03-12 12:40:38 -07:00
Tsz-Wo Nicholas Sze
981a1fa815 HDFS-6833. DirectoryScanner should not register a deleting block with memory of DataNode. Contributed by Shinichi Yamashita 2015-03-13 02:27:37 +08:00
Xuan
498d775c9b YARN-3338. Exclude jline dependency from YARN. Contributed by Zhijie 
Shen

(cherry picked from commit 06ce1d9a6cd9bec25e2f478b98264caf96a3ea44)
 2015-03-12 10:25:55 -07:00
cnauroth
86bb9c5808 HADOOP-10027. *Compressor_deflateBytesDirect passes instance instead of jclass to GetStaticObjectField. Contributed by Hui Zheng. 
(cherry picked from commit ff83ae72318fe6c0f266a7bf08138bd2fdb51cbd)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
 2015-03-11 23:28:36 -07:00
Zhijie Shen
426535007b YARN-1884. Added nodeHttpAddress into ContainerReport and fixed the link to NM web page. Contributed by Xuan Gong. 
(cherry picked from commit 85f6d67fa78511f255fcfa810afc9a156a7b483b)
 2015-03-11 19:39:46 -07:00
Akira Ajisaka
6c80a3d34a HDFS-7880. Remove the tests for legacy Web UI in branch-2. Contributed by Brahma Reddy Battula. 2015-03-12 10:41:34 +09:00
cnauroth
dcc4850ff3 HADOOP-11693. Azure Storage FileSystem rename operations are throttled too aggressively to complete HBase WAL archiving. Contributed by Duo Xu. 
(cherry picked from commit 7a346bcb4fa5b56191ed00a39e72e51c9bdf1b56)
 2015-03-11 14:37:22 -07:00
Haohui Mai
e75e6c66ea HADOOP-11633. Convert remaining branch-2 .apt.vm files to markdown. Contributed by Masatake Iwasaki. 2015-03-11 14:23:44 -07:00
cnauroth
5e99b7cd2f HDFS-7491. Add incremental blockreport latency to DN metrics. Contributed by Ming Ma. 
(cherry picked from commit fb34f45727e63ea55377fe90241328025307d818)
 2015-03-11 14:11:39 -07:00
Tsuyoshi Ozawa
d29cf296cb YARN-3295. Fix documentation nits found in markdown conversion. Contributed by Masatake Iwasaki. 
(cherry picked from commit 30c428a858c179645d6dc82b7027f6b7e871b439)
 2015-03-11 15:02:45 +09:00
Colin Patrick Mccabe
eefca23e8c HDFS-7830. DataNode does not release the volume lock when adding a volume fails. (Lei Xu via Colin P. McCabe) 
(cherry picked from commit 5c1036d598051cf6af595740f1ab82092b0b6554)
 2015-03-10 19:45:18 -07:00
Gera Shegalov
f1b32d1436 DelegateToFileSystem erroneously uses default FS's port in constructor. (Brahma Reddy Battula via gera) 
(cherry picked from commit 64eb068ee8863da41df8db44bde1a9033198983d)
 2015-03-10 14:10:39 -07:00
Gera Shegalov
6802e8fefc MAPREDUCE-4815. Speed up FileOutputCommitter#commitJob for many output files. (Siqi Li via gera) 
(cherry picked from commit aa92b764a7ddb888d097121c4d610089a0053d11)
 2015-03-10 11:40:45 -07:00
Jian He
2690c72522 YARN-3187. Documentation of Capacity Scheduler Queue mapping based on user or group. Contributed by Gururaj Shetty 
(cherry picked from commit a380643d2044a4974e379965f65066df2055d003)
 2015-03-10 11:16:51 -07:00
Tsuyoshi Ozawa
482504befd MAPREDUCE-4742. Fix typo in nnbench#displayUsage. Contributed by Liang Xie. 
(cherry picked from commit 20b8ee1350e62d1b21c951e653302b6e6a8e4f7e)
 2015-03-11 00:41:37 +09:00