AI-Mock-Interviewer/PDF_Extracted_Data huggingface dataset:
Question: what is elastic beanstalk?
Answer: Answer:AWS Elastic Beanstalk is the fastest and simplest way to get an application up and running on AWS.Developers can simply upload their code and the service automatically handle all the details such as resource provisioning, l oad balancing, Auto scaling and Monitoring.
Question: what is amazon light sail?
Answer: Follow  Me : https://www.yo utube.com/c/SauravAgarwa l Answer:Lightsail  designed to be the easiest way to launch and manage a virtual private server with AWS.Lightsail plans include everything you need to jumpstart your project a virtual machine, ssd based storage, data transfer, DNS Management and a static ip.
Question: what is ebs?
Answer: Answer:Amazon EBS Provides persistent block level storage volumes for use with Amazon EC2 instances. Amazon EBS volume is automatically replicated with its availability zone to protect component failure offering high availability and durability. Am azon EBS volumes are available in a variety of types that differ in performance characteristics and Price.
Question: how to compare ebs volumes?
Question: what is cold hdd and throughput optimized hdd?
Question: what is amazon ebs optimized instances?
Question: what is ebs snapshot?
Question: how to connect ebs volume to multiple instance?
Answer: Answer: We cant able to connect EBS volume to multiple instance, but we can able to connect multiple EBS Volume to single instance.
Question: what are the virtualization types available in aws?
Question: differentiate block storage and file storage?
Answer: Answer: Block Storage: Block storage operates a t lower level, raw storage device level and manages data as a set of numbered, fixed size blocks. File Storage: File storage operates at a higher level, the operating system level and manage data as a named hierarchy of files and folders.
Question: what are the advantage and disadvantage of efs advantages
Answer: Answer:  Fully managed service  File system grows and shrinks automatically to petabytes  Can support thousands of concurrent connections  Multi AZ replication  Throughput scales automatically to ensure consisten t low latency Disadvantages:  Not available in all region  Cross region capability not available  More complicated to provision compared to S3 and EBS
Question: what are the things we need to remember while creating s3 bucket?
Answer: Answer:  Amazon S3 and Bucket names a re  This means bucket names must be unique across all AWS  Bucket names can contain upto 63 lowercase letters, numbers, hyphens and  You can create and use multiple buckets  You can have upto 100 per account by
Question: follow me https www youtube comcsauravagarwalq139 what are the storage class available in amazon s3?
Question: explain amazon s3 lifecycle rules?
Question: what is the relation between amazon s3andawskms?
Answer: Answer: To encrypt Amazon S3 data at rest, you can use several v ariations of Server -Side Encryption. Amazon S3 encrypts your data at the object level as it writes it to disks in its data centers and decrypt it for you when you access itll SSE performed by Amazon S3 and AWS Key Management Service (AWS KMS) uses the 256 -bit Advanced Encryption Standard (AES).
Question: what is the function of cross region replication in amazon s3?
Answer: Answer: Cross region replication is a feature allows you asynchronously replicate all new objects in the source bucket in one AWS region to a targ et bucket in another region. To enable cross -region replication, versioning must be turned on for both source and destination buckets. Cross region replication is commonly used to reduce the latency required to access objects in Amazon S3
Question: how to create encrypted ebs volume?
Question: what is nat instance and nat gateway?
Question: what is vpc peering?
Answer: Answer: Amazon VPC peering connection is a networking connection between two amazon vpcs that enables instances in either Amazon VPC to communicate with each other as if they are within the same network. You can create amazon VPC peering connection betwee n your own Amazon VPCs or Amazon VPC in another AWS account within a single region.
Question: what is mfa in aws?
Answer: Answer:  Multi factor Authentication can add an extra layer of security to your infrastructure by adding a second method of authentication beyond just password or access key.
Question: what are the authentication in aws?
Answer: Answer:  User Name/Password  Access Key  Access Key/ Session Token
Question: what is data warehouse in aws?
Answer: Data ware house is a central repository for data that can come from one or more sour ces. Organization typically use data warehouse to compile reports and search the database using highly complex queries. Data warehouse also typically updated on a batch schedule multiple times per day or per hour compared to an OLTP (Online Transaction Pro cessing) relational database that can be updated thousands of times per second.
Question: what is mean by multi az in rds?
Answer: Answer:  Multi AZ allows you to place a secondary copy of your database in another availability zone for disaster recovery purpose. Multi AZ deployments are available for all types of Amazon RDS Database engines. When you create s Multi -AZ DB instance a primary instance is created in one Availability Zone and a secondary instance is created by another Availability zone.
Question: what is amazon dynamo db?
Answer: Answer: Amazon Dynamo DB is fully managed NoSQL database service that provides fast and predictable performance with seamless scalability. Dynamo DB makes it simple and Cost effective to store and retrieve any amount of data.
Question: what is cloud formation?
Question: how to plan auto scaling?
Answer: Answer:  Manual Scaling  Scheduled Scal ing  Dynamic Scaling
Question: what is auto scaling group?
Answer: Answer: Auto Scaling group is a collection of Amazon EC2 instances managed by the Auto scaling service. Each auto scaling group contains configuration options that control when auto scaling should launc h new instance or terminate existing instance.
Question: differentiate basic and detailed monitoring in cloud watch?
Answer: Answer: Basic Monitoring: Basic monitoring sends data points to Amazon cloud watch every five minutes for a limited number of preselected metrics at no charge. Detailed Monitoring: Detailed monitoring sends data points to amazon CloudWatch every minute and allows data aggregation for an additional charge.
Question: what is the relationship between route 53 and cloud front?
Question: what are the routing policies available in amazon route 53?
Answer: Answer:  Simple  Weighted  Latency Based  Failover  Geolocation
Question: what is amazon elastic ache?
Answer: Answer: Amazon ElastiCache  is a web services that simplifies the setup and management of distributed in memory caching environment.  Cost Effective  High Performance  Scalable Caching Environment  Using Memcached or Redis Cache Engine
Question: follow me https www youtube com c saurav agarwal q159whatissessqsandsns?
Question: how to use amazon sqs what is a ws?
Answer: Answer:Amazon Web Services is a secure cloud services stage, offering compute power, database storage, content deliv ery and other functionality to help industries scale and grow.
Question: what is the importance of buffer in aws?
Question: what is the way to secure data for resounding in the cloud?
Answer: Answer:  Avoid storage sensitive material in the cloud.   Read  the user contract to find out how your cloud service storing works.   Be serious about passwords.   Encrypt.   Use an encrypted cloud service.
Question: name the several layers of cloud computing?
Question: what is lambda edge in aws?
Answer: Answer:Lambda Edge lets y ou run Lambda functions to modify satisfied that Cloud Front delivers, executing the functions in AWS locations closer to the viewer. The functions run in response to Cloud Front events, without provisioning or managing server.
Question: distinguish between scalability and flexibility?
Question: what is ia as?
Question: what is pa as?
Answer: Answer:PaaS runs cloud platforms and runtime environments to develop, test and manage software Users: Software Developers
Question: what is saas?
Question: which automation gears can help with spin up services?
Question: what is an ami how do i build one?
Question: what are the main features of amazon cloud front?
Answer: Answer:Amazon Cloud Front is a web service that speeds up delivery of your static and dynamic web content, such as .html, .css, .js, and image files, to your users.CloudFront delivers your content through a universal network of data centers called edge loc ations
Question: what are the features of the amazon ec2 service?
Question: explain storage for amazon ec2 instance?
Answer: Answer:An instance store is a provisional storing type located on disks that are physicall y attached to a host machine.  This article will present you to the AWS instance store storage type, compare it to AWS Elastic Block Storage (AWS EBS), and show you how to backup data stored on instance stores to AWS EBS Amazon SQS is a message queue serv ice used by scattered requests to exchange messages through a polling model, and can be used to decouple sending and receiving components Q174)  When attached to an Amazon VPC which two components provide connectivity with
Question: external networks?
Question: which of the following are characteristics of amazon vpc subnets?
Answer: Answer:  Each subnet maps to a single Availability Zone.  By defaulting, all subnets can route between each other, whether they are private or public.
Question: how can you send request to amazon s3?
Answer: Follow  Me : https://www.yo utube.com/c/SauravAgarwa l Answer:Every  communication with Amazon S3 is either genuine or anonymous. Authentication is a process of validating the individuality of the requester trying to access an Amazon Web Services (AWS) product. Genuine requests must include a autograph value that authentic ates the request sender. The autograph value is, in part, created from the requesters AWS access keys (access key identification and secret access key).
Question: what is the best approach to anchor information for conveying in the cloud?
Question: what i saws certificate manager?
Question: what is amazon emr?
Answer: Answer:Amazon Elastic MapReduce (EMR) is one such administration that gives completely oversaw facilitated Hadoop system over Amazon Elastic Compute Cloud (EC2).
Question: what is amazon kinesis firehose?
Question: what is amazon cloud search and its highlights?
Question: private cloud?
Question: how would one be able to associate a vpc to corporate serverfarm?
Answer: Answer:AWS Direct Connect empowers you to safely associate your AWS condition to your on - premises server farm or office area over a standard 1 gigabit or 10 gigabit Ethernet fiber -optic association. AWS Direct Connect offers committed fast, low dormancy association, which sidesteps web access suppliers in your system way. An AWS Direct Connect area gives access to Amazon Web Services in the locale it is related with, and also access to diffe rent US areas. AWS Direct Connect enables you to consistently parcel the fiber -optic associations into numerous intelligent associations called Virtual Local Area Networks (VLAN). You can exploit these intelligent associations with enhance security, separa te traffic, and accomplish consistence necessities.
Question: is it conceivable to push of fs3withec2 examples?
Question: what is the distinction between amazon s3andebs?
Question: follow me https www youtube comcsauravagarwalq188 what do you comprehend by aws?
Answer: Answer:This is one of the generally asked AWS engineer inquiries questions. This inquiry checks your es sential AWS learning so the appropriate response ought to be clear. Amazon Web Services (AWS) is a cloud benefit stage which offers figuring power, investigation, content conveyance, database stockpiling, sending and some different administrations to help you in your business development. These administrations are profoundly versatile, solid, secure, and cheap distributed computing administrations which are plot to cooperate and, applications in this manner made are further developed and escalade.
Question: clarify the principle components of aws?
Question: im not catching your meaning by ami what does it incorporate?
Question: is vertically scale is conceivable on amazon occurrence?
Question: what is the association among ami and instance?
Question: what is the distinction between amazon s3andec2?
Question: what number of capacity alternatives are therefore c2 instance?
Question: what are the security best practices for amazon ec2 examples?
Question: what is the system to send a demand to amazon s3?
Question: what is the default number of basins made in aws?
Answer: Answer :This is an extremely straightforward inquiry yet positions high among AWS engineer inquiries questions. Answer this inquiry straightforwardly as the default number of pails made in each AWS account is 100.
Question: what is the motivation behind t2 examples?
Answer: Answer:T2 cases are intended for Providing moderate gauge execution Follow  Me : https://www.yo utube.com/c/SauravAgarwa l Higher execution as required by outstanding task at hand
Question: what is the utilization of the cradle in aws?
Answer: Answer:This is among habitually asked AWS designer inquiries  questions. Give the appropriate response in straightforward terms, the cradle is primarily used to oversee stack with the synchronization of different parts i.e. to make framework blame tolerant. Without support, segments dont utilize any reasonable tech nique to get and process demands. Be that as it may, the cushion makes segments to work in a decent way and at a similar speed, hence results in quicker administrations.
Question: what happens when an amazon ec2 occurrence is halted or ended?
Answer: Answer:At the season of ceasing an Amazon EC2 case, a shutdown is performed in a typical way. From that point onward, the changes to the ceased state happen. Amid this, the majority of the Amazon EBS volumes are stayed joined to the case and the case can b e begun whenever. The occurrence hours are not included when the occasion is the ceased state. At the season of ending an Amazon EC2 case, a shutdown is performed in an ordinary way. Amid this, the erasure of the majority of the Amazon EBS volumes is perfo rmed. To stay away from this, the estimation of credit deleteOnTermination is set to false. On end, the occurrence additionally experiences cancellation, so the case cant be begun once more.
Question: what are the mainstream dev ops devices?
Question: what are the defaults services we get when we create custom aws vpc?
Answer: Answer:  Route Table Follow  Me : https://www.yo utube.com/c/SauravAgarwa l  Network ACL  Security Group
Question: what is the difference between public subnet and private subnet?
Question: how do you access the ec2 which has private ip which is in private subnet?
Question: what are the difference between route 53andelb?
Question: follow me https www youtube comcsauravagarwalq210 what are the db engines which can be used in aws rds?
Answer: Answer:  MariaDB  MYSQL DB  MS SQL DB  Postgre DB  Oracle DB
Question: what is status checks in awsec2?
Question: to establish a peering connections between two vpcs what condition must be met?
Question: how ebs can be accessed?
Question: what is the maximum file length ins3?
Answer: Answer: utf -8 1024 bytes
Question: which activity can not be done using auto scaling?
Answer: Answer:Maintain fixed running of ec2
Question: how will you secure data at rest in ebs?
Answer: Answer: EBS data is always secure
Question: what is the maximum size of s3 bucket?
Answer: Answer: 5TB
Question: can objects in amazon s3 be delivered through amazon cloud front?
Answer: Answer:Yes Q239)  which service is used to distribute content to end user service using global network of
Question: edge location?
Answer: Answer: Virtual Private Cloud
Question: what i sep he maral storage?
Answer: Answer: Temporary storage
Question: what are shards in kinesis aws services?
Answer: Answer: Shards are used to store data in Kinesis.
Question: where can you find the ephemeral storage?
Question: on the public cloud what is the architecture called?
Answer: Answer:Virtual private cloud
Question: route 53 can be used to route users to infrastructure outside of aws true false?
Answer: Answer: False
Question: is simple workflow service one of the valid simple notification service subscribers?
Answer: Follow  Me : https://www.yo utube.com/c/SauravAgarwa l Answer: No Q246)  which cloud model do Developers and organizations all around the world leverage
Question: extensively?
Question: can cloud front serve content from a non aws origin server?
Answer: Answer: No
Question: is efsa centralised storage service in aws?
Answer: Answer: Yes Q249)  Which AWS service will you use to collect and process ecommerce data for near real time
Question: analysis?
Question: would you recommend?
Question: follow me https www you tubecomcsauravagarwal1 how much data you are processing everyday?
Question: on what types of data you are working?
Question: how many tables you are having in your rdbms and what is the size of each table on a average?
Question: how you use sq oop incremental load and how to stop the sq oop incremental job?
Question: how many rows you are getting after doing select from tablename?
Question: how much time it is taking to process the data in hive and spark?
Question: how much data is getting appended everyday?
Question: on what frequency means how many times you are using your sq oop job in a day or in a week?
Answer: 9.  How you are reusing the RDD(RDD transformations) with scenarios.
Question: what types of processing you are doing through your hive and spark?
Question: when to user dd and data frame?
Answer: https://databricks.com/blog/2016/07 /14/a -tale-of-three -apache -spark -apis-rdds-datafram es-and-datasets.html
Question: why rdd is immutable?
Answer: https://www.quora.com/Why -is-RDD -immutable -in-Spark
Question: what is the difference between spark context and spark session?
Answer: http://data -flair.training/forums/topic/sparksession -vs-sparkcontext -in-apache -spark
Question: what is the difference between partitioning bucket ing repartitioning and coalesce?
Answer: Follow  Me : https://www.yo utube.com/c/SauravAgarwa l https://data -flair.training/blogs/hive -partitioning -vs-bucketing/ https://stackover flow.com/questions/31610971/spark -repartition -vs-coalesce
Question: how to debug your spark code and how to build the jar?
Question: how are you scheduling your jobs using oo zie?
Question: how to select data from a hive external partitioned table?
Answer: http://blog.zhengdong.me/2 012/02/22/hive -external -table-with-partitions/
Question: when to use spark client and cluster mode?
Question: what is your cluster configuration and versions of each component?
Question: realtime use cases of companion objects and trait?
Question: how to fetch data from a scala list in a parallel manner?
Answer: Not exactly the answer, but helpful https://alvinalexander.com/scala/how -to-use-parallel -collections -in-scala -performance
Question: how to increase spark executor memory and hive utilisation memory?
Answer: https://stackoverflow.com/questions/26562033/how -to-set-apache -spark -executor -memo ry 23. Different  types  of  Nosql  databases.What  is  the  difference  between  hbase  and Cassandra. https://www.3pillarglobal.com/insights/exploring -the-different -types -of-nosql -databases Follow  Me : https://www.yo utube.com/c/SauravAgarwa l https://data -flair.training/blogs/hbase -vs-cassandra/
Question: questions regarding different file formats of had oop and when to use?
Answer: Useful blog: https://community.hitachivantara.com/community/products -and-solutions/pentaho/blog/2 017/11/ 07/hadoop -file-formats -its-not-just-csv-anymore
Question: what is the difference between hive map join and hive bucket join?
Answer: https://data -flair.training/blogs/map -join-in-hive/ https://data -flair.training/blogs/bucket -map-join/ 26. Performance optimization techniques in sqoop,hive and spark. Hive - https://hortonworks.com/blog/5 -ways -make -hive-queries -run-faster/ 27. End to end project flow and the usage of all the hadoop ecosyst em components.
Question: why does apache spark exist and how py spark fits into the picture?
Question: what is the filesize you are using in your development and production environment?
Question: use cases of accumulators and broadcast variables?
Question: explain the difference between internal and external tables?
Question: when to use?
Answer: 1. Use internal table if its data wont be used by other bigdata Ecosystems. Follow  Me : https://www.yo utube.com/c/SauravAgarwa l 2. Use external table if its data would be used by other bigdata ecosystems as it wont have any impact just in case of table drop operation
Question: how did you run hive load scripts in production?
Answer: Ans: All the hive commands were kept in .sql files ( for ex - load ordersdata.sql) and these files were invoked in in Unix shell script through command: hive -f ordersdata.sql. These unix  scripts had few other HDFS commands as well. For ex - To load data into HDFS, make backup on local file system, send email once load was done etc. etc.). These unix scripts were called through Enterprise scheduler ( Control M or Autosys or Zookeeper).
Question: why does hive doesnt store metadata in hdfs?
Answer: Ans: 1.Storing metadata in HDFS results in high latency/delay considering the fact of sequential access in HDFS for read/write operations. So its evident to store metadata in Metastore to achieve low lat ency because of random access in metastore(MySQL dB)
Question: which file format works best with hive tables why?
Question: how to append files of various dfs?
Question: how will you solve this problem and list the steps that i will be taking in order to do so?
Question: why map reduce will not run if you run select from table in hive?
Question: how to import first 10 records from a rdbms table into hdfs using sq oop how to import all
Question: the records except first 20rows records and also last 50recordsusingsqoop import?
Question: what is the difference between kafka and flume?
Answer: 40. How to change the number of replication factors and how to change the number of mappers and
Question: reducers?
Question: how the number of partitions and stages get decided in spark?
Question: what is the default number of mappers and reducers in map reduce job?
Question: how to change the block size while importing the data into hdfs?
Answer: Follow  Me : https://www.yo utube.com/c/SauravAgarwa l 44. What setting need to be done while doing dynamic partition and bucketing.
Question: how to run map reduce and spark job?
Question: what is datasets in spark and how to create and use it?
Question: what are the difference between hive and h base hive and rdbms no sql and rdbms?
Question: what are the difference between had oop and rdbms?
Question: what are the difference between had oop and spark?
Answer: 50. What are the difference between Scala and Java.
Question: what are the advantages and disadvantages of functional programming?
Question: what are the advantages of had oop over distributed filesystems?
Answer: 53. Core concept of map reduce internal architecture and job flow. 54. Architecture of Hadoop,Yarn and Spark.
Question: what are the advantages of using yarn as cluster manager than me so sands park standalone cm?
Answer: Company Specific Questions Follow  Me : https://www.yo utube.com/c/SauravAgarwa l Company: Fedility  Date: 07 -Aug-2018
Question: what security authentication you are using how you are managing?
Question: about c entry security authentication?
Answer: 3. how do you do schedule the jobs in Fair scheduler 4. prioritizing jobs
Question: how you are doing ac center l control for hdfs?
Answer: 6. Disaster Recovery activities 7. what issues you are faced so far 8. do you know about puppet 9. hadoop development activities Company: Accenture  Dt: 06 -July-2018
Question: what are your daily activities and what are your roles and responsibilities in your current
Question: project what are the services that are implemented in your current project?